Orbiter History

Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 878198 reports (Page 15657 of 17564)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................X................] duration: 5.813866256s FAIL (2025-08-09 04:39:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.813895322s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [...................X...........X........X...................] duration: 717.248799ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:39:49 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 717.280409ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X......X.....XXX........X........X.........................] duration: 6.032138055s FAIL (2025-08-09 04:39:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.032158585s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 459.361144ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:39:31 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 459.388947ms edge linksharing us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..............X...................] duration: 747.934377ms FAIL (2025-08-09 04:39:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 747.980917ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X................X......................] duration: 2.527387998s FAIL (2025-08-09 04:39:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.527412284s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 488.005057ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:39:15 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 488.031688ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [..X......X.....XXX........X........X........................] duration: 5.992771804s FAIL (2025-08-09 04:39:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.992798466s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X........X............................................] duration: 1.878372118s FAIL (2025-08-09 04:39:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.878397679s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [....................X...........X........X..................] duration: 694.1019ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:38:50 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 694.125325ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..............X..................] duration: 730.207452ms FAIL (2025-08-09 04:38:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 730.230757ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X............................X...............] duration: 5.687634999s FAIL (2025-08-09 04:38:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.687658454s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 493.705594ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:38:39 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 493.724811ms edge linksharing us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..............X.................] duration: 781.610911ms FAIL (2025-08-09 04:38:32 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 781.636421ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration: 2.047304735s FAIL (2025-08-09 04:38:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 2.047329143s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X................X.....................] duration: 2.447934479s FAIL (2025-08-09 04:38:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.447944319s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...X......X.....XXX........X........X.......................] duration: 6.222405465s FAIL (2025-08-09 04:38:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.222420884s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X........X..........................................] duration: 1.8362781s FAIL (2025-08-09 04:38:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.836307597s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X............................X..............] duration: 5.582595079s FAIL (2025-08-09 04:38:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.582624115s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...........X........X.................] duration: 726.294707ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:38:02 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 726.322949ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [....X......X.....XXX........X........X......................] duration: 6.598630571s FAIL (2025-08-09 04:37:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.598651502s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X................X....................] duration: 2.367928734s FAIL (2025-08-09 04:37:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.367944655s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 451.049592ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:37:40 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 451.076092ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 1.81976721s FAIL (2025-08-09 04:37:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.819791627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [......................X...........X........X................] duration: 719.560992ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:37:32 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 719.600337ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X............................X.............] duration: 5.780758094s FAIL (2025-08-09 04:37:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.780782292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [............................X..............X................] duration: 728.852781ms FAIL (2025-08-09 04:37:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 728.881355ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 480.756542ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:37:16 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 480.779836ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X................X...................] duration: 2.260464303s FAIL (2025-08-09 04:37:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.260479733s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 1.903925931s FAIL (2025-08-09 04:37:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.903955366s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....X......X.....XXX........X........X.....................] duration: 6.27944172s FAIL (2025-08-09 04:37:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.279461317s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..............X...............] duration: 729.554542ms FAIL (2025-08-09 04:36:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 729.573278ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X............................X............] duration: 5.570974774s FAIL (2025-08-09 04:36:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.571003789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X................X..................] duration: 2.368158013s FAIL (2025-08-09 04:36:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.36817621s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...........X........X...............] duration: 740.435ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:36:24 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 740.462964ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [......X......X.....XXX........X........X....................] duration: 6.010469978s FAIL (2025-08-09 04:36:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.01049162s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 1.833817177s FAIL (2025-08-09 04:36:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.833842084s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 472.063834ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:36:07 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 472.081878ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......X......X.....XXX........X........X...................] duration: 6.041775591s FAIL (2025-08-09 04:35:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.041800769s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..............X..............] duration: 752.724476ms FAIL (2025-08-09 04:35:47 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 752.745336ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X................X.................] duration: 2.346597363s FAIL (2025-08-09 04:35:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.346612662s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 460.3715ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:35:38 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 460.402559ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [........................X...........X........X..............] duration: 740.367891ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:35:31 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 740.396176ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..............X.............] duration: 732.21314ms FAIL (2025-08-09 04:35:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 732.24027ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X............................X...........] duration: 5.674962721s FAIL (2025-08-09 04:35:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.674994963s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [........X......X.....XXX........X........X..................] duration: 6.256652032s FAIL (2025-08-09 04:35:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.256690346s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X................X................] duration: 2.695426571s FAIL (2025-08-09 04:35:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.695450577s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 1.851659514s FAIL (2025-08-09 04:35:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.851690684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...........X........X.............] duration: 705.838556ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:35:13 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 705.86097ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 491.23868ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:35:06 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 491.260853ms edge linksharing us-select-1

1
...
15655
15656
15657
15658
15659
...
17564