Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X............................X........] duration: 5.914127668s FAIL (2025-08-09 04:33:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.914151182s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 483.025006ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:33:10 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 483.041899ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X................X.............] duration: 2.324406455s FAIL (2025-08-09 04:33:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.324421875s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [............X......X.....XXX........X........X..............] duration: 6.464437138s FAIL (2025-08-09 04:33:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.464457097s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X............................X.......] duration: 5.661402305s FAIL (2025-08-09 04:33:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.661438062s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [............................X...........X........X..........] duration: 726.57931ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:32:57 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 726.606372ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X............................X......] duration: 6.028105765s FAIL (2025-08-09 04:32:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 6.028188413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X................X............] duration: 2.513040601s FAIL (2025-08-09 04:32:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.513054838s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.............................X...........X........X.........] duration: 722.537828ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:32:35 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 722.560671ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 1.857496734s FAIL (2025-08-09 04:32:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.857525889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..............X..........] duration: 733.032617ms FAIL (2025-08-09 04:32:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 733.064649ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 460.949188ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:32:13 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 461.016978ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.............X......X.....XXX........X........X.............] duration: 6.426198592s FAIL (2025-08-09 04:32:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.426221785s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 1.872844852s FAIL (2025-08-09 04:32:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.872873257s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X............................X.....] duration: 5.924527486s FAIL (2025-08-09 04:31:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.92455055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X................X...........] duration: 2.314579362s FAIL (2025-08-09 04:31:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.314594982s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [X.............................X...........X........X........] duration: 696.259157ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:31:49 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 696.278093ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..............X.........] duration: 745.362789ms FAIL (2025-08-09 04:31:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 745.406682ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 485.40051ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:31:24 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 485.430798ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [..............X......X.....XXX........X........X............] duration: 6.074247957s FAIL (2025-08-09 04:31:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.074267706s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [.X.............................X...........X........X.......] duration: 719.048601ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:31:22 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 719.080762ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X........X................................] duration: 1.889142622s FAIL (2025-08-09 04:31:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.889169804s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..............X........] duration: 719.632008ms FAIL (2025-08-09 04:30:55 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 719.664329ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X............................X....] duration: 5.647124707s FAIL (2025-08-09 04:30:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.647149656s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...............X......X.....XXX........X........X...........] duration: 6.078193144s FAIL (2025-08-09 04:30:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.078249943s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X................X..........] duration: 2.31158282s FAIL (2025-08-09 04:30:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.311599512s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X........X...............................] duration: 2.148653046s FAIL (2025-08-09 04:30:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 2.14869652s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X............................X...] duration: 5.642070038s FAIL (2025-08-09 04:30:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.642098322s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..............X.......] duration: 770.169922ms FAIL (2025-08-09 04:30:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 770.188999ms edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 458.197964ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:30:21 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 458.244303ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [..X.............................X...........X........X......] duration: 720.070809ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:30:17 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 720.09688ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X............................X..] duration: 5.937629849s FAIL (2025-08-09 04:30:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.937661169s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..............X......] duration: 11.6617778s FAIL (2025-08-09 04:30:07 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 11.661816405s edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X................................X................X.........] duration: 2.524919979s FAIL (2025-08-09 04:29:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.525058074s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 501.592401ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:29:39 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 501.621656ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [................X......X.....XXX........X........X..........] duration: 6.254403729s FAIL (2025-08-09 04:29:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.254427173s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..............X.....] duration: 708.079674ms FAIL (2025-08-09 04:29:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 708.119079ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X........X..............................] duration: 1.886080323s FAIL (2025-08-09 04:29:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.886110972s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [...X.............................X...........X........X.....] duration: 706.936087ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:29:21 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 706.960834ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X............................X.] duration: 5.854208666s FAIL (2025-08-09 04:29:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 5.854234424s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..............X....] duration: 718.735073ms FAIL (2025-08-09 04:29:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 718.759519ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.................X......X.....XXX........X........X.........] duration: 5.973506577s FAIL (2025-08-09 04:28:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.973535712s edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 481.35459ms remote: "tcp:45.38.24.2:80" target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-09 04:28:38 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": context deadline exceeded Duration: 481.377365ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration: 1.835994012s FAIL (2025-08-09 04:28:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 9 04:07:10.334620288 (10h41m4.765700419s) [upload=11163]: Starting upload Aug 9 04:07:10.334666016 (10h41m4.765746147s) [upload=11163]: Done starting upload Aug 9 04:07:10.334726181 (10h41m4.765806312s) [upload=11163]: Uploading segments... Aug 9 04:07:10.334759073 (10h41m4.765839204s) [upload=11163]: Got next segment. Inline: true Aug 9 04:07:10.334763161 (10h41m4.765843292s) [upload=11163]: Waiting for error group managing segments... Aug 9 04:07:10.334796215 (10h41m4.765876336s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:07:10.334800333 (10h41m4.765880464s) [upload=11163]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 04:07:10.334802918 (10h41m4.765883049s) [upload=11163]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:07:11.359905316 (10h41m5.790985467s) [upload=11163]: Done uploading segments... Aug 9 04:07:11.359924452 (10h41m5.791004594s) [upload=11163]: Upload finished. err: <nil> Duration:* 1.836013099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [....X.............................X...........X........X....] duration: 739.138961ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:28:34 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 739.161213ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..............X...] duration: 770.529862ms FAIL (2025-08-09 04:28:32 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 770.557134ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X................................X................X........] duration: 2.321635585s FAIL (2025-08-09 04:28:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.321659432s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.............................X............................X] duration: 6.181612767s FAIL (2025-08-09 04:28:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 300e406ae21c2fcce26f6c605fe9ed2f359b3c5a4aa8f0f0653b4dbf9d0cd372 != before 8ca49ef939bb8940d1a7ebf435b18b46df2b5ccd48bcff9caec1a53b09bacd18 ======LOGS====== Aug 9 04:28:02.761508612 (11h1m57.192588743s) [upload=11525]: Starting upload Aug 9 04:28:02.761562866 (11h1m57.192642997s) [upload=11525]: Done starting upload Aug 9 04:28:02.761650103 (11h1m57.192730234s) [upload=11525]: Uploading segments... Aug 9 04:28:02.761744363 (11h1m57.192824484s) [upload=11525]: Got next segment. Inline: false Aug 9 04:28:02.761775131 (11h1m57.192855262s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:28:02.761782566 (11h1m57.192862697s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:28:03.210386904 (11h1m57.641467035s) [seg_pos={0 0}, upload=11525]: Begin upload segment... Aug 9 04:28:03.210435497 (11h1m57.641515628s) [seg_pos={0 0}, upload=11525]: Done begin upload segment. Aug 9 04:28:03.210457027 (11h1m57.641537158s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210833799 (11h1m57.64191392s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.210974778 (11h1m57.642054909s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211101631 (11h1m57.642181762s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211375716 (11h1m57.642455837s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211424408 (11h1m57.642504529s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211643337 (11h1m57.642723468s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211712790 (11h1m57.642792911s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211887364 (11h1m57.642967495s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.211979251 (11h1m57.643059382s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212115662 (11h1m57.643195793s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212250148 (11h1m57.643330279s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212527039 (11h1m57.64360717s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.212778440 (11h1m57.643858571s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213082241 (11h1m57.644162372s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213313944 (11h1m57.644394075s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213524888 (11h1m57.644605019s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:03.213736192 (11h1m57.644816313s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Uploading piece... Aug 9 04:28:04.382454970 (11h1m58.813535101s) [upload=11525]: Next returned nil segment Aug 9 04:28:04.382468235 (11h1m58.813548366s) [upload=11525]: Waiting for error group managing segments... Aug 9 04:28:04.677773586 (11h1m59.108853717s) [noise=true , address=64.49.13.27:4967 , piece_id=T5G5KOONLNABE2A5U5VU3P4I55DA3PXU25XO7CCF3ZUIXIHGF2YQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.133260472 (11h1m59.564340603s) [noise=true , address=104.36.82.38:4689 , piece_id=QQTYGPXNOGHTHSV2SYARKYNTLG4TSRI7AGQRFEQGZEGQGZ32AC2Q, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.151398255 (11h1m59.582478376s) [noise=true , address=104.36.82.12:4175 , piece_id=L232I74WAUV523MFT55AVOVV6IUGTE74PQMNUVI3WBBP4ET4DUKQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.153901544 (11h1m59.584981675s) [noise=true , address=104.36.82.18:4391 , piece_id=KR7GNOHLAQVZDR4FBMRYM6D4WLA4OBAUAAUHATF7YFYJTRZ5GWDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.158419409 (11h1m59.58949954s) [noise=true , address=104.36.82.39:4741 , piece_id=MOINC3M74TCMXVY6ZZITSACPQNBDSHK2MT5JVLYOTHCECA24EM3A, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.164967618 (11h1m59.596047739s) [noise=true , address=104.36.82.35:4598 , piece_id=DXOO2SXPJKJ72JFSCYUBCGBD3B275GA2W5WYYTTQFUV4WXYQR2TA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.185761402 (11h1m59.616841533s) [noise=true , address=104.36.82.34:4560 , piece_id=3OFDP3HAL22DCLHL3HCXZ6AQLRF4YWPJAUCHUSUN5B3RDA4KOQDQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.191617917 (11h1m59.622698048s) [noise=true , address=104.36.82.22:4544 , piece_id=AVKQTDZTJX5ZIQSQ6HPR6F6ZS67NONDHVLGVZXN6UQCEUVYP7YLA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207005869 (11h1m59.63808599s) [noise=true , address=104.36.82.45:4929 , piece_id=P6HCCKBWNP6FVU26XQKEAY6R7PBOWAA4DBZAWMIX5GPHMQVUCJPQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.207195422 (11h1m59.638275553s) [noise=true , address=104.36.82.44:4900 , piece_id=4G5KQTA2TETYBOKCPS7LQ4YGC6IH6IEX55HYXGLQRDLNUTUAJ5DA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.216004366 (11h1m59.647084487s) [noise=true , address=104.36.82.23:4467 , piece_id=JT7PO22ZTL6HKDLYIP3M5K7MHWQE2CDEZXV63TWYHNQRQSIZ6HXQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.242527884 (11h1m59.673608005s) [noise=true , address=104.36.82.19:4417 , piece_id=CJVPA4UFCXFC4CVQ2AZTL2Q36BHYJULHVKFTFRALGUU5XIZQSDMQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.245978056 (11h1m59.677058187s) [noise=true , address=45.91.116.9:4282 , piece_id=7ZP25W6HFRX2RS5AE3Z7BQCNDHL23OEGJX4KGDKPWJXL7JG434XQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260361064 (11h1m59.691441186s) [noise=true , address=104.36.82.37:4664 , piece_id=EHZM4CD2TX2USUD7XDZXU2H22CNPEF7JTTG4TGVXX4VYDJ74LWYQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: <nil> Aug 9 04:28:05.260385301 (11h1m59.691465422s) [seg_pos={0 0}, upload=11525]: Segment reached optimal threshold of 14 pieces. Aug 9 04:28:05.260497235 (11h1m59.691577366s) [noise=true , address=104.36.82.47:4526 , piece_id=2UTSZEZZQ3BBVTHXB3VB6DNFKR3ZZ42GWWNBBZLBCCRNZBQ5K2AA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260546900 (11h1m59.691627021s) [noise=true , address=104.36.82.60:4370 , piece_id=VIMSL4MZ7URLZO6UQC7ZNF7CQWBEM64ROAILTUDGQ7ZZNBRN5QNQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LBgixGGgNeYs63ZSpkYJmrEGr3W9Ma1s2Sj8cCxU6mUxm1aC): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260600653 (11h1m59.691680784s) [noise=true , address=104.36.82.5:4855 , piece_id=QQ2R33E67IUQMYVLDF4FENDYJQKWE7W2G7BYK36NK7R4VLSQW4BA, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260608448 (11h1m59.691688569s) [noise=true , address=104.36.82.59:4315 , piece_id=2HH7V445RPWO3TN4BD3EJTYG27MBCYUI5VX4ANPKQZUODGI4MFGQ, seg_pos={0 0}, upload=11525]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz): protocol: expected piece hash; context canceled; EOF Aug 9 04:28:05.260634217 (11h1m59.691714338s) [seg_pos={0 0}, upload=11525]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:28:05.260713850 (11h1m59.691793981s) [upload=11525]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:28:05.260718208 (11h1m59.691798339s) [upload=11525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:28:06.259547615 (11h2m0.690627746s) [upload=11525]: Done uploading segments... Aug 9 04:28:06.259567373 (11h2m0.690647504s) [upload=11525]: Upload finished. err: <nil> Duration: 6.181641731s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..............X..] duration: 768.066617ms FAIL (2025-08-09 04:28:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 768.116853ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [..................X......X.....XXX........X........X........] duration: 6.050331558s FAIL (2025-08-09 04:27:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.05035396s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)