Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.....................X...........................] duration: 6.726281719s FAIL (2025-08-13 04:23:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.726313501s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.206875884s FAIL (2025-08-13 04:23:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.206900942s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.849535244s FAIL (2025-08-13 04:22:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.849560663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 7.849383877s FAIL (2025-08-13 04:22:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.849407383s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X.....................X..........................] duration: 6.407302379s FAIL (2025-08-13 04:22:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.407324752s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.85487883s FAIL (2025-08-13 04:22:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.854905301s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 15.579974679s FAIL (2025-08-13 04:21:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 15.580016309s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X.....................X.........................] duration: 5.956748518s FAIL (2025-08-13 04:21:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.956776862s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.836153249s FAIL (2025-08-13 04:21:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.836182234s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.853555525s FAIL (2025-08-13 04:20:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.853579612s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 14.553988463s FAIL (2025-08-13 04:20:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.554007379s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.....................X........................] duration: 6.201386569s FAIL (2025-08-13 04:20:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.201415753s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 8.302993462s FAIL (2025-08-13 04:20:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.303049871s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.83901212s FAIL (2025-08-13 04:19:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.839029532s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X.....................X.......................] duration: 5.824726944s FAIL (2025-08-13 04:19:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.824748577s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 7.567223065s FAIL (2025-08-13 04:19:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.567242332s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X.....................X......................] duration: 5.980741465s FAIL (2025-08-13 04:19:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.980766261s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.892058026s FAIL (2025-08-13 04:19:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.89208192s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 7.789930301s FAIL (2025-08-13 04:18:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.789954909s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.....................X.....................] duration: 6.581309974s FAIL (2025-08-13 04:18:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.581336756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.866903955s FAIL (2025-08-13 04:18:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.866929013s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 10.935657598s FAIL (2025-08-13 04:18:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.935682928s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X.....................X....................] duration: 6.269469146s FAIL (2025-08-13 04:18:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.269501098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X.....................X...................] duration: 6.81921969s FAIL (2025-08-13 04:17:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.819249228s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.844854819s FAIL (2025-08-13 04:17:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.844880267s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 7.462701041s FAIL (2025-08-13 04:16:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.462712834s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 14.007906205s FAIL (2025-08-13 04:16:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 14.007933587s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.037638737s FAIL (2025-08-13 04:16:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.037671429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X.....................X..................] duration: 6.17479005s FAIL (2025-08-13 04:16:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.174815558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 10.50109831s FAIL (2025-08-13 04:15:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.501124079s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X.....................X.................] duration: 6.048269989s FAIL (2025-08-13 04:15:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.048303975s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.83869976s FAIL (2025-08-13 04:15:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.83874184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00149351s FAIL (2025-08-13 04:15:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001512135s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.843066036s FAIL (2025-08-13 04:15:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.843091834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.....................X................] duration: 5.903142945s FAIL (2025-08-13 04:14:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.903168403s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.860202445s FAIL (2025-08-13 04:14:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.860229006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X.....................X...............] duration: 6.221215899s FAIL (2025-08-13 04:14:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.221236137s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.....................X..............] duration: 6.46741347s FAIL (2025-08-13 04:13:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.467441024s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.852830226s FAIL (2025-08-13 04:13:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.852855604s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X.....................X.............] duration: 5.992135567s FAIL (2025-08-13 04:13:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.992159061s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.884901413s FAIL (2025-08-13 04:13:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.884928344s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.....................X............] duration: 5.860614584s FAIL (2025-08-13 04:12:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.860645313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.....................X...........] duration: 6.137819322s FAIL (2025-08-13 04:12:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.137851785s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.829863063s FAIL (2025-08-13 04:12:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.829886197s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.....................X..........] duration: 6.215261176s FAIL (2025-08-13 04:12:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.215289961s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X.....................X.........] duration: 6.152138577s FAIL (2025-08-13 04:11:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.152166551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.958411212s FAIL (2025-08-13 04:11:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.958438043s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X............................X.....................X........] duration: 5.891216261s FAIL (2025-08-13 04:11:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.891242431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.000344173s FAIL (2025-08-13 04:11:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.000360345s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X............................X.....................X.......] duration: 5.66696232s FAIL (2025-08-13 04:10:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.666994431s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)