Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 893.555321ms FAIL (2025-08-09 04:06:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 893.582162ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 748.298243ms FAIL (2025-08-09 04:06:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 748.324141ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X....X.........................X......X....] duration: 11.219814012s FAIL (2025-08-09 04:06:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.219835562s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X............X..........................] duration: 5.761744338s FAIL (2025-08-09 04:06:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.761777522s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...................X...............................] duration: 2.276346964s FAIL (2025-08-09 04:06:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.276371039s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.849200957s FAIL (2025-08-09 04:06:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.849230896s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X............X.........................] duration: 5.771749021s FAIL (2025-08-09 04:05:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.771776463s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................X..............................] duration: 2.359090133s FAIL (2025-08-09 04:05:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.359113236s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 733.492242ms FAIL (2025-08-09 04:05:46 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 733.51699ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X............X........................] duration: 5.832258924s FAIL (2025-08-09 04:05:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.832279904s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.892364242s FAIL (2025-08-09 04:05:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.89239458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X....X.........................X......X...] duration: 6.015683137s FAIL (2025-08-09 04:05:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.015698968s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.880871404s FAIL (2025-08-09 04:05:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.88089607s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X....X.........................X......X..] duration: 6.331817594s FAIL (2025-08-09 04:05:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.33184123s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.....................................................X.....] duration: 2.000610858s FAIL (2025-08-09 04:04:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 2.000632019s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X....X.........................X......X.] duration: 6.020179752s FAIL (2025-08-09 04:04:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.020199509s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 711.526988ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:04:43 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 711.557677ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................X.............................] duration: 2.356812173s FAIL (2025-08-09 04:04:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.35685843s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 761.316029ms FAIL (2025-08-09 04:04:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 761.343161ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X......................X............X.......................] duration: 5.877868468s FAIL (2025-08-09 04:04:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.877894419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 778.258363ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:04:23 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 778.276337ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X....X.........................X......X] duration: 30.001185171s FAIL (2025-08-09 04:04:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001233926s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X......................X............X......................] duration: 5.607025022s FAIL (2025-08-09 04:04:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.60705493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 788.956271ms FAIL (2025-08-09 04:03:46 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 788.990117ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.....................................................X....] duration: 1.974856703s FAIL (2025-08-09 04:03:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.974897572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................X............................] duration: 2.33234393s FAIL (2025-08-09 04:03:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.332357767s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X......................X............X.....................] duration: 5.767767583s FAIL (2025-08-09 04:03:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.76779827s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 741.608241ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:03:24 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 741.63902ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X......................X............X....................] duration: 5.649450537s FAIL (2025-08-09 04:03:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.649473983s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.243137843s FAIL (2025-08-09 04:02:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2.243165726s edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................................................X...] duration: 1.847901902s FAIL (2025-08-09 04:02:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.847926249s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X....X.........................X......] duration: 5.871042106s FAIL (2025-08-09 04:02:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.871065812s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X......................X............X...................] duration: 5.519953031s FAIL (2025-08-09 04:02:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.519982619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...................X...........................] duration: 2.513510566s FAIL (2025-08-09 04:02:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.513543368s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 792.734701ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:02:23 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 792.75489ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................................................X..] duration: 1.827075086s FAIL (2025-08-09 04:01:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.827099101s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X......................X............X..................] duration: 5.798820004s FAIL (2025-08-09 04:01:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.798844872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X....X.........................X.....] duration: 6.170956888s FAIL (2025-08-09 04:01:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.170976135s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...................X..........................] duration: 2.215735222s FAIL (2025-08-09 04:01:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.215784785s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 778.05187ms FAIL (2025-08-09 04:01:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 778.103469ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...................X.........................] duration: 2.875620583s FAIL (2025-08-09 04:01:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.875645713s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X.....................................................X.] duration: 1.850747103s FAIL (2025-08-09 04:01:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.850770168s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 777.577101ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:01:10 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 777.607169ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X......................X............X.................] duration: 5.587207497s FAIL (2025-08-09 04:00:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.58723583s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X....X.........................X....] duration: 6.904241619s FAIL (2025-08-09 04:00:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.904291864s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 754.684893ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:00:49 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 754.701886ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................................................X] duration: 1.601188139s FAIL (2025-08-09 04:00:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 9 04:00:44.031914630 (10h34m38.462994761s) [upload=11045]: Starting upload Aug 9 04:00:44.031999122 (10h34m38.463079273s) [upload=11045]: Done starting upload Aug 9 04:00:44.032079866 (10h34m38.463160018s) [upload=11045]: Uploading segments... Aug 9 04:00:44.032130493 (10h34m38.463210645s) [upload=11045]: Got next segment. Inline: true Aug 9 04:00:44.032136515 (10h34m38.463216666s) [upload=11045]: Waiting for error group managing segments... Aug 9 04:00:44.032181160 (10h34m38.463261301s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:00:44.032185889 (10h34m38.463266061s) [upload=11045]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:00:44.032189486 (10h34m38.463269617s) [upload=11045]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:00:44.308646572 (10h34m38.739726703s) [upload=11045]: Done uploading segments... Aug 9 04:00:44.308669115 (10h34m38.739749257s) [upload=11045]: Upload finished. err: <nil> Duration:* 1.601214048s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 777.229916ms FAIL (2025-08-09 04:00:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 777.253631ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X....X.........................X...] duration: 6.205384678s FAIL (2025-08-09 04:00:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.20544326s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X......................X............X................] duration: 5.761096181s FAIL (2025-08-09 04:00:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a3fdca05b1ec41e0bbd4c1a83a584488522a70c6feb24cf7b60f183a2ba15291 != before 5edb1daf27b32cf603c14a8b3835c6acab1f7641869c0855cf40818e0fcd5d3e ======LOGS====== Aug 9 03:49:32.732372560 (10h23m27.163452691s) [upload=10857]: Starting upload Aug 9 03:49:32.732420131 (10h23m27.163500262s) [upload=10857]: Done starting upload Aug 9 03:49:32.732510123 (10h23m27.163590294s) [upload=10857]: Uploading segments... Aug 9 03:49:32.732655432 (10h23m27.163735583s) [upload=10857]: Got next segment. Inline: false Aug 9 03:49:32.732753950 (10h23m27.163834091s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:49:32.732762416 (10h23m27.163842557s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:49:33.207897454 (10h23m27.638977595s) [seg_pos={0 0}, upload=10857]: Begin upload segment... Aug 9 03:49:33.207943382 (10h23m27.639023513s) [seg_pos={0 0}, upload=10857]: Done begin upload segment. Aug 9 03:49:33.207975573 (10h23m27.639055704s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.207985984 (10h23m27.639066115s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208321105 (10h23m27.639401236s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208408983 (10h23m27.639489114s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208575501 (10h23m27.639655632s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208763050 (10h23m27.639843181s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.208888910 (10h23m27.639969042s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209139531 (10h23m27.640219662s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209366735 (10h23m27.640446866s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209590774 (10h23m27.640670905s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.209977163 (10h23m27.641057294s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210206942 (10h23m27.641287063s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210394000 (10h23m27.641474142s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210422385 (10h23m27.641502516s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210612539 (10h23m27.64169266s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.210980002 (10h23m27.642060133s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.211397080 (10h23m27.642477211s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:33.212167264 (10h23m27.643247395s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Uploading piece... Aug 9 03:49:34.720787603 (10h23m29.151867725s) [upload=10857]: Next returned nil segment Aug 9 03:49:34.720803674 (10h23m29.151883805s) [upload=10857]: Waiting for error group managing segments... Aug 9 03:49:35.113563924 (10h23m29.544644085s) [noise=true , address=104.36.82.45:4924 , piece_id=QY7YY3HLDUCUUZJNTSXJ5QB5TNNX2UGUNN45T5D3G3MBYEORNPQQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120536454 (10h23m29.551616585s) [noise=true , address=45.91.116.9:4266 , piece_id=FTMR3TUEVVRUG6TPBW7D6BGUD65THN2MDPW6EDQRJ2NOUJIYHMJQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.120565800 (10h23m29.551645931s) [noise=true , address=104.36.82.62:4410 , piece_id=7MMB3NQFRKIHYLM2ADUJPFTPTSGOY2557LEYRTR2LHRJ5LDCPNAQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.121370019 (10h23m29.55245015s) [noise=true , address=104.36.82.38:4704 , piece_id=WZ3G2B3CMLHASVPID52JYXPCUPD25ITGJHBAM4YXLXZMUGK2CN4A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.130782448 (10h23m29.561862579s) [noise=true , address=104.36.82.36:4633 , piece_id=FZHY7BSKF4ODI5MGZI4AH466QOYSZA3TY6C4JQSRBHSIVRQSGDKQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.155389939 (10h23m29.58647006s) [noise=true , address=104.36.82.47:4524 , piece_id=6PQNFOSY4MPE3XI25HN3OERPJ6UV5IMUWFWW46AF6DFVSWQRDAEQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.172833955 (10h23m29.603914086s) [noise=true , address=45.91.116.4:4969 , piece_id=WGSF5MJY6J5RYKEZKNANIPT7JJNPMWYBMMMU4PKWEBJQQKHFCQHQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.193702944 (10h23m29.624783065s) [noise=true , address=104.36.82.43:4860 , piece_id=XYNG4OBLHH5F4IDGKS4GA2M75G62UEDPNPEYNNQ7MKTSA6A4W36Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195456249 (10h23m29.62653638s) [noise=true , address=104.36.82.23:4467 , piece_id=AJC3PR7Y7B5FEA4KVO5ZCN7X2PAAA65DI62VOOUSZ2TQIRAJNH7Q, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.195809405 (10h23m29.626889536s) [noise=true , address=104.36.82.37:4680 , piece_id=F7ME3UDOWBJHDVQCL6AHC3CQOXM6PED2B7Z3Z6RWBPP75UFM667A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.204886963 (10h23m29.635967084s) [noise=true , address=104.36.82.11:4121 , piece_id=6OFOVKMGWNZX2GMXFWAB2HN3I7MG4VVQ7O7QMPB52HDQDCD3CHEA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215040920 (10h23m29.646121051s) [noise=true , address=104.36.82.54:4159 , piece_id=X2NHLNFR67YTHOUYGT7DZJESQ66RCPHHSTNNTKIWRJA3FO2XEICA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.215378746 (10h23m29.646458877s) [noise=true , address=104.36.82.8:4983 , piece_id=CS2PVJ2TLOSFRCH4CL55UIDM5VEVHG7UVDFALNFR2UCQPEGFYMCA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231400511 (10h23m29.662480642s) [noise=true , address=104.36.82.55:4203 , piece_id=HCAPSVIET2TSKZA3QHWSEXILW5UMKK5BK7AK6RAFZJOXTZEDC7SA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: <nil> Aug 9 03:49:35.231439866 (10h23m29.662519997s) [seg_pos={0 0}, upload=10857]: Segment reached optimal threshold of 14 pieces. Aug 9 03:49:35.231537804 (10h23m29.662617935s) [noise=true , address=104.36.82.44:4878 , piece_id=BABM32PQDDFERRTH2ITPM2M64NCNXRLLPH4ITB4WE2OJVV6PWQ7A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wX9xRmyv3KWVyJhFmgBt9uYqDU6U768dqHagKZeKBSEnFup5y): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231620051 (10h23m29.662700172s) [noise=true , address=104.36.82.39:4746 , piece_id=4QRN4L76FZYGNTGL55TFKZNMXMBB4DGCHF5RT3MOHCVDLGTPDHBQ, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBP5cx63KB8oMuzhuq78a1V88januH2X5K3MzJGdXxFvXD4VM): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231662061 (10h23m29.662742192s) [noise=true , address=104.36.82.16:4324 , piece_id=W3TE2QMHPUPLWJMWBXA5LLTNB6AJU7J34T6MT433NQADFLB7XG2A, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tmAP2k9LHn7tGVu5Ky9pLpwQ4aXettco3TRZ1fbmEC5SESkga): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231678132 (10h23m29.662758263s) [noise=true , address=104.36.82.59:4330 , piece_id=UXTMWVFB4SP53NNRUGY72UQ27DYTBYCPJXVVMVBW4766KQWD7BTA, seg_pos={0 0}, upload=10857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eu7SDhEXZGS6HeAXFZWfxoci2oPdjtYvZ5Bbhvae2neKTxYKo): protocol: expected piece hash; context canceled; EOF Aug 9 03:49:35.231715513 (10h23m29.662795644s) [seg_pos={0 0}, upload=10857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:49:35.231792531 (10h23m29.662872662s) [upload=10857]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:49:35.231797510 (10h23m29.662877641s) [upload=10857]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:49:35.663004331 (10h23m30.094084452s) [upload=10857]: Done uploading segments... Aug 9 03:49:35.663024048 (10h23m30.094104169s) [upload=10857]: Upload finished. err: <nil> Duration: 5.761140716s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)