Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 764.536932ms FAIL (2025-08-09 03:44:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 764.5572ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X....X........] duration: 7.761150522s FAIL (2025-08-09 03:44:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.761176702s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X...................X......] duration: 2.611915177s FAIL (2025-08-09 03:44:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.611933783s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.................X......................X.....] duration: 5.520269293s FAIL (2025-08-09 03:44:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.520296274s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 758.168679ms FAIL (2025-08-09 03:44:36 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 758.194498ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 702.358861ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:44:27 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 702.375042ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 49.136859285s FAIL (2025-08-09 03:44:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 49.136876638s edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...................X.....] duration: 26.423666019s FAIL (2025-08-09 03:44:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 26.423690185s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................X..................................] duration: 1.88470739s FAIL (2025-08-09 03:44:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.884736675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X....X.......] duration: 7.113131251s FAIL (2025-08-09 03:43:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.113154245s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.................X......................X....] duration: 5.82031451s FAIL (2025-08-09 03:43:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.820334438s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 762.751999ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:43:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 762.781686ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X.....................X.................................] duration: 1.878552969s FAIL (2025-08-09 03:43:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.87857894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X...................X....] duration: 2.665404682s FAIL (2025-08-09 03:43:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.665435771s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 748.925552ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:43:29 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 748.938658ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m0.000807366s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:43:28 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.00083072s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................X................................] duration: 1.854402688s FAIL (2025-08-09 03:43:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.854428358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X....X......] duration: 6.123037732s FAIL (2025-08-09 03:43:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.123059973s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.....X.....................X...............................] duration: 1.914386524s FAIL (2025-08-09 03:43:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.91442083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 718.988212ms FAIL (2025-08-09 03:43:01 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 719.014823ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...................X...] duration: 2.372813746s FAIL (2025-08-09 03:42:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.372840216s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.................X......................X...] duration: 5.564094374s FAIL (2025-08-09 03:42:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.564123521s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.984794494s FAIL (2025-08-09 03:42:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 3.984831594s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.....X.....................X..............................] duration: 1.846131981s FAIL (2025-08-09 03:42:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.846157388s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...................X..] duration: 5.447643456s FAIL (2025-08-09 03:42:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.447672512s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X....X.....] duration: 6.229905537s FAIL (2025-08-09 03:42:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.22992254s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.................X......................X..] duration: 5.846169558s FAIL (2025-08-09 03:42:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.846202431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 728.069519ms FAIL (2025-08-09 03:41:58 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 728.095898ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.X.....X.....................X.............................] duration: 1.838899471s FAIL (2025-08-09 03:41:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.839037414s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 739.446056ms FAIL (2025-08-09 03:41:28 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 739.501512ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X....X....] duration: 6.026820523s FAIL (2025-08-09 03:41:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.027135295s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.................X......................X.] duration: 5.735786865s FAIL (2025-08-09 03:41:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 5.735808678s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...................X.] duration: 9.699533807s FAIL (2025-08-09 03:41:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.69955637s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...................X] duration: 30.001247004s FAIL (2025-08-09 03:40:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001261922s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.X.....X.....................X............................] duration: 1.90265103s FAIL (2025-08-09 03:40:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.902684084s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 760.696055ms FAIL (2025-08-09 03:40:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 760.71947ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.................X......................X] duration: 3.88488s FAIL (2025-08-09 03:40:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:40:25.683200488 (10h14m20.114280619s) [upload=10700]: Starting upload Aug 9 03:40:25.683263398 (10h14m20.114343529s) [upload=10700]: Done starting upload Aug 9 03:40:25.683362748 (10h14m20.11444288s) [upload=10700]: Uploading segments... Aug 9 03:40:25.683445747 (10h14m20.114525878s) [upload=10700]: Got next segment. Inline: false Aug 9 03:40:25.683473711 (10h14m20.114553842s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:40:25.683478910 (10h14m20.114559042s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:40:26.156449907 (10h14m20.587530039s) [seg_pos={0 0}, upload=10700]: Begin upload segment... Aug 9 03:40:26.156492979 (10h14m20.58757311s) [seg_pos={0 0}, upload=10700]: Done begin upload segment. Aug 9 03:40:26.156514340 (10h14m20.587594471s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156553015 (10h14m20.587633146s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.156934595 (10h14m20.588014726s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157024627 (10h14m20.588104748s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157247634 (10h14m20.588327765s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157365940 (10h14m20.588446071s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157595169 (10h14m20.5886753s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157668338 (10h14m20.588748469s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.157901936 (10h14m20.588982067s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158022907 (10h14m20.589103058s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158166072 (10h14m20.589246203s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158303064 (10h14m20.589383195s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158463009 (10h14m20.58954314s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158545116 (10h14m20.589625247s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158691487 (10h14m20.589771618s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158896939 (10h14m20.58997707s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.158931445 (10h14m20.590011566s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:26.161735521 (10h14m20.592815652s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Uploading piece... Aug 9 03:40:27.257643042 (10h14m21.688723173s) [upload=10700]: Next returned nil segment Aug 9 03:40:27.257660546 (10h14m21.688740677s) [upload=10700]: Waiting for error group managing segments... Aug 9 03:40:27.574301088 (10h14m22.005381219s) [noise=true , address=64.49.13.26:4954 , piece_id=KANPNKHTCNRSMSB6QUG6W6O5TS44P7IUXDQMOWB7QMWOJVJKUQJA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.576335580 (10h14m22.007415711s) [noise=true , address=64.49.13.139:4469 , piece_id=W3GWGVQDDXJDXEMIIRWPCAUGXK6M7YLSEQPHVS33DN74GKVMET6Q, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.594193598 (10h14m22.02527373s) [noise=true , address=64.49.13.169:4707 , piece_id=G6ETVBSF52PVDXBNRM5KNDCA5XP3VMWKM25A7ZTLC2T2JR7LDMTQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:27.634423473 (10h14m22.065503604s) [noise=true , address=64.49.13.155:4914 , piece_id=7WAYOBPQ5GIWTT25TJ2TEHN33QFWUKT6AN4NJELCVWAI7Y2YDOAA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.055760869 (10h14m22.486841001s) [noise=true , address=104.36.82.59:4302 , piece_id=FZ63B7YWLHB7YYGAPVIMVM7DBXPKI2KBRAUVJYVBHACJFWO6HA6A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.061817267 (10h14m22.492897398s) [noise=true , address=104.36.82.18:4376 , piece_id=VMSNPB3NLVWLSSCEUQV4EVHWPGERI7EZZELXV6C7RL65DQVBQAWA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.072298151 (10h14m22.503378272s) [noise=true , address=104.36.82.55:4223 , piece_id=QQXRETA434OOAGFK5Y5NM3AA7CCNQ54H3ZRXQJAMHGXEJUW5OSNQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.112271515 (10h14m22.543351646s) [noise=true , address=104.36.82.61:4382 , piece_id=PCY2TESPYRTP6T7TPI5UNK2Q5MFJSSFUCQFZBHACDLAFY2KWIJQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.130055512 (10h14m22.561135643s) [noise=true , address=45.91.116.12:4237 , piece_id=Z2OGCQPSSRWJWEUGJJ3SK2D67ZLW4WUH54UZ3RCRS2NCDRZZV3VA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.138789293 (10h14m22.569869424s) [noise=true , address=104.36.82.9:4023 , piece_id=GLOBSPCWMZV4EKN2LBXRKPI2RGGVV5ZN7SS3FBFFZQD3OXSN6XKA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.143178662 (10h14m22.574258793s) [noise=true , address=104.36.82.60:4371 , piece_id=KNVYPKN2ZRA44GB46RA5Z4JFTY3JUHAOUTFZKOVKGS6636TSV4KQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.151621496 (10h14m22.582701617s) [noise=true , address=104.36.82.37:4654 , piece_id=OC3XO6A2TIQVLYM725WXVFRZGH4G4OJHGULCDXHS5WJHUV3TQRHA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.155326135 (10h14m22.586406266s) [noise=true , address=104.36.82.38:4712 , piece_id=XMCTDOW3ZIGGW3RLVNCDE4PFSNLYUA472SFQVFSZP2PQZ5MPX6WQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160570910 (10h14m22.591651041s) [noise=true , address=104.36.82.61:4385 , piece_id=JEBII7LPGNEDA567XEG7AX7YCHP2DVRLLDMTKEDESWHDFVB7IV3A, seg_pos={0 0}, upload=10700]: Done uploading piece. err: <nil> Aug 9 03:40:28.160593383 (10h14m22.591673514s) [seg_pos={0 0}, upload=10700]: Segment reached optimal threshold of 14 pieces. Aug 9 03:40:28.160740564 (10h14m22.591820685s) [noise=true , address=104.36.82.8:4001 , piece_id=BGTSRCII55TFTEC2CQAWWSOBMERDOYLDEQS7NSWSIZ2ZFSJD3XZQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Eaef5RrMHiZS6dE7wTXyq239F1RXovU7UCTQ7uC6Qusj6bJDw): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160820878 (10h14m22.591900999s) [noise=true , address=104.36.82.62:4438 , piece_id=CONOUDOM3UQ5BXMBBTSRLBLHDFJTYMKMUQUTJVGCTQZ4CCAO5UQA, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r45NCqiic7hJHEm5f2ho7TvCkT15cgGVHMKqxuJZThDH4Eqq9): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160936248 (10h14m22.592016379s) [noise=true , address=104.36.82.4:4836 , piece_id=B6GG2O4C7JFHXVP4WDOE5BP4726TYIKXZQOCL6YCMBN64YGPL7PQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160942300 (10h14m22.592022431s) [noise=true , address=45.91.116.8:4063 , piece_id=O5MEIZ5KY64XEUSODPB2VAIP4GCUAPISRQFG4PLAT43NZFCPRHSQ, seg_pos={0 0}, upload=10700]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K5nU4YVCDnYSVvAWxbnWqB2pM4pTadgwqBWt4oeNpToz2X9xm): protocol: expected piece hash; context canceled; EOF Aug 9 03:40:28.160979852 (10h14m22.592059983s) [seg_pos={0 0}, upload=10700]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:40:28.161071708 (10h14m22.592151839s) [upload=10700]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:40:28.161076376 (10h14m22.592156507s) [upload=10700]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:40:28.459096020 (10h14m22.890176151s) [upload=10700]: Done uploading segments... Aug 9 03:40:28.459117670 (10h14m22.890197842s) [upload=10700]: Upload finished. err: <nil> Duration: 3.884915137s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X....X...] duration: 5.907528143s FAIL (2025-08-09 03:40:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.907558722s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.....X.....................X...........................] duration: 1.863456606s FAIL (2025-08-09 03:40:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.863516571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.658103341s FAIL (2025-08-09 03:39:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.658124662s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 814.025524ms FAIL (2025-08-09 03:39:48 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 814.055071ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.X.....X.....................X..........................] duration: 1.857398745s FAIL (2025-08-09 03:39:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.85742215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..................X.................X......................] duration: 5.653582601s FAIL (2025-08-09 03:39:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.653610675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X....X..] duration: 6.145432201s FAIL (2025-08-09 03:39:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.145455003s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.X.....X.....................X.........................] duration: 1.969124748s FAIL (2025-08-09 03:39:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1f07e513a453b173929d386ad4b96990b9120f94a895401b277314042594accb != before 43581b85841a71f0eeabf39e38a501f8ac5a00df48aeb44689adffd57ebbe5a1 ======LOGS====== Aug 9 03:19:05.059331412 (9h52m59.490411543s) [upload=10320]: Starting upload Aug 9 03:19:05.059369795 (9h52m59.490449926s) [upload=10320]: Done starting upload Aug 9 03:19:05.059416335 (9h52m59.490496466s) [upload=10320]: Uploading segments... Aug 9 03:19:05.059451081 (9h52m59.490531212s) [upload=10320]: Got next segment. Inline: true Aug 9 03:19:05.059454929 (9h52m59.49053505s) [upload=10320]: Waiting for error group managing segments... Aug 9 03:19:05.059486139 (9h52m59.49056627s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:19:05.059490557 (9h52m59.490570688s) [upload=10320]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:19:05.059493342 (9h52m59.490573473s) [upload=10320]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:19:05.548860658 (9h52m59.979940789s) [upload=10320]: Done uploading segments... Aug 9 03:19:05.548879022 (9h52m59.979959154s) [upload=10320]: Upload finished. err: <nil> Duration:* 1.969153875s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.46904903s FAIL (2025-08-09 03:39:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.469071032s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 752.121458ms FAIL (2025-08-09 03:39:02 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 752.15343ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..................X.................X.....................] duration: 5.886670659s FAIL (2025-08-09 03:39:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:24:14.228326086 (9h58m8.659406217s) [upload=10413]: Starting upload Aug 9 03:24:14.228376623 (9h58m8.659456754s) [upload=10413]: Done starting upload Aug 9 03:24:14.228531360 (9h58m8.659611531s) [upload=10413]: Uploading segments... Aug 9 03:24:14.228699671 (9h58m8.659779802s) [upload=10413]: Got next segment. Inline: false Aug 9 03:24:14.228752933 (9h58m8.659833094s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:24:14.228759997 (9h58m8.659840138s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:24:14.687349067 (9h58m9.118429208s) [seg_pos={0 0}, upload=10413]: Begin upload segment... Aug 9 03:24:14.687397730 (9h58m9.118477861s) [seg_pos={0 0}, upload=10413]: Done begin upload segment. Aug 9 03:24:14.687427206 (9h58m9.118507338s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687436945 (9h58m9.118517086s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.687828444 (9h58m9.118908575s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688139319 (9h58m9.11921945s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688439492 (9h58m9.119519634s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688447949 (9h58m9.11952808s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688790104 (9h58m9.119870235s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.688800865 (9h58m9.119880996s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689065440 (9h58m9.120145571s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689088394 (9h58m9.120168515s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689359774 (9h58m9.120439905s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689375824 (9h58m9.120455955s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689602328 (9h58m9.120682459s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689659407 (9h58m9.120739538s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.689971524 (9h58m9.121051655s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690166767 (9h58m9.121246899s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690230430 (9h58m9.121310551s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:14.690731839 (9h58m9.12181197s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Uploading piece... Aug 9 03:24:15.853114587 (9h58m10.284194718s) [upload=10413]: Next returned nil segment Aug 9 03:24:15.853130628 (9h58m10.284210759s) [upload=10413]: Waiting for error group managing segments... Aug 9 03:24:16.150481430 (9h58m10.581561561s) [noise=true , address=64.49.13.26:4951 , piece_id=SMBJX7TC2WEDQKL64YCHTM2NX3TYF2J667B6KNQXASSQTDN3LBSA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.591032647 (9h58m11.022112768s) [noise=true , address=104.36.82.46:4512 , piece_id=AL3V3U53OFXTPL2J5TGZ3EMTTPYNKH4H6OIQRCNZIH4XENVKWIFQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.592789358 (9h58m11.023869489s) [noise=true , address=104.36.82.9:4035 , piece_id=KIXTEQIWFHYBR4EGKWZRRHNVGY2S46XX6DUA55CNXHXBYSXMDMAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.596957302 (9h58m11.028037433s) [noise=true , address=104.36.82.39:4751 , piece_id=IXLB7II2LVR2G4FU36N5V7FDBHYC7QOSPZ5TNHMVKWLOAIA4ALZA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.597509168 (9h58m11.028589299s) [noise=true , address=104.36.82.35:4608 , piece_id=CQMYTVEXZIKNM4CRZOV4Q2LCNHKEQLM3J73GJA4EIXB2MDUH6B5Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.604094979 (9h58m11.03517511s) [noise=true , address=104.36.82.58:4278 , piece_id=UW3OMP5WNI45HVUSB6S4L4BUVKJDOPESQ22MHEPPIGPPIW4M4M3A, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.605047942 (9h58m11.036128073s) [noise=true , address=104.36.82.37:4666 , piece_id=CZMGZEP3ZE7DHP3CKB67DCZTROCL7JKPVL3A7DCNVUZE6UQU7BPA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.606641681 (9h58m11.037721812s) [noise=true , address=104.36.82.53:4149 , piece_id=4NC5NJ6XKERVBX3CKL6MQSKENM7HKUMH3UCGQLN3YUFNQHCQCDQA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.660395378 (9h58m11.091475509s) [noise=true , address=45.91.116.9:4266 , piece_id=WEACZFCVARKXKFOUS7SUEMJ37K33XKMXWKI73TPTWRE6G2VBD5PQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.661987965 (9h58m11.093068096s) [noise=true , address=104.36.82.23:4453 , piece_id=UKOIHJ6RYVV7NNN36EMMKLYR6Y5YDR2UBIFLBMLU46O7IRIEVZPQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.666036521 (9h58m11.097116652s) [noise=true , address=104.36.82.59:4317 , piece_id=IIOWJAA746544WPKFKSTUS3TM2EUH2B74NOIG75MIOTMNASQHUOQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.695180362 (9h58m11.126260493s) [noise=true , address=104.36.82.17:4340 , piece_id=UJHXNR2WKREX67T7WN67TKERIZQDLKXFEE2HZOZ6GQIS2CH7XA3Q, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.703535378 (9h58m11.134615499s) [noise=true , address=104.36.82.13:4192 , piece_id=ZJHH25COTHQQVDAGK3GHAVAFSB2KFISTVL2FFQTZVBNYHX2RIIYA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704312815 (9h58m11.135392936s) [noise=true , address=77.90.31.16:4766 , piece_id=B773NBBX5FIPEMLAMKJN3YYYJEHTCQCRKZYB77R4C2VVHGEP7UMA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: <nil> Aug 9 03:24:16.704324839 (9h58m11.13540497s) [seg_pos={0 0}, upload=10413]: Segment reached optimal threshold of 14 pieces. Aug 9 03:24:16.704433627 (9h58m11.135513758s) [noise=true , address=104.36.82.12:4182 , piece_id=OSHN3N3GDVWQXU6RFM23ETWTTMKNFJHJZJPJ4RKOPXKDYPFLGHAA, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSPtVhJPKYAb3Gj25ihyExNgkDCGo9QTDaFcEfXRfLdDz8nsh): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704523940 (9h58m11.135604071s) [noise=true , address=104.36.82.60:4349 , piece_id=MTFIU4T7WNU2EMXA4YZZKGWZ7I5GZP5ENMSQEIAIF6GROHA7SESQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704584936 (9h58m11.135665067s) [noise=true , address=104.36.82.6:4880 , piece_id=FUR3NTJS7G2KVBYZO6SCW33IMCQ6QID3ZZECG67FQ55ODMMR4HIQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125NsQhq7kRmTjKS8nuc51PZddApFEi5C38FzC5pEX2QrWYKzSW): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704595988 (9h58m11.135676119s) [noise=true , address=45.91.116.11:4150 , piece_id=BBOIQJMNJSKEOZ65MDYNN6LMIPH5MG2JTP4KX7MPKFA44XR36YJQ, seg_pos={0 0}, upload=10413]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N5XGFCAo5JX9Wmgsgt2iarMQW3A6Q5rkdEEyBVx6beWDeC7WQ): protocol: expected piece hash; context canceled; EOF Aug 9 03:24:16.704643267 (9h58m11.135723399s) [seg_pos={0 0}, upload=10413]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:24:16.704731457 (9h58m11.135811588s) [upload=10413]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:24:16.704736316 (9h58m11.135816447s) [upload=10413]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:24:17.008678078 (9h58m11.439758199s) [upload=10413]: Done uploading segments... Aug 9 03:24:17.008697475 (9h58m11.439777606s) [upload=10413]: Upload finished. err: <nil> Duration: 5.886700305s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.355700092s FAIL (2025-08-09 03:38:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.35571915s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X....X.] duration: 7.43221318s FAIL (2025-08-09 03:38:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.43225526s edge gateway us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)