Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X............................X.....................X.....] duration: 5.631738451s FAIL (2025-08-13 04:09:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.631767767s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.833314036s FAIL (2025-08-13 04:09:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.833340015s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X............................X.....................X....] duration: 6.92181051s FAIL (2025-08-13 04:08:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.921842653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X............................X.....................X...] duration: 6.188521507s FAIL (2025-08-13 04:08:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 6.188547315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.855986857s FAIL (2025-08-13 04:08:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.85600903s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X............................X.....................X..] duration: 5.858670443s FAIL (2025-08-13 04:07:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.858702965s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.160214571s FAIL (2025-08-13 04:07:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.16023978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X............................X.....................X.] duration: 5.947742368s FAIL (2025-08-13 04:06:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.947768207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X............................X.....................X] duration: 5.702103725s FAIL (2025-08-13 04:06:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a6ab6965f6133e239ccbdf66a1f0be1fef1b0dc5e2e5b52bff2d0f5fa9076658 != before 6fdcc254ba2040cdf14130b98887fb9416aa1dadc61de52caf01724e5ed02bc8 ======LOGS====== Aug 13 04:06:26.424773439 (106h40m20.85585362s) [upload=111021]: Starting upload Aug 13 04:06:26.424859403 (106h40m20.855939584s) [upload=111021]: Done starting upload Aug 13 04:06:26.424943213 (106h40m20.856023344s) [upload=111021]: Uploading segments... Aug 13 04:06:26.425371873 (106h40m20.856452014s) [upload=111021]: Got next segment. Inline: false Aug 13 04:06:26.425416889 (106h40m20.85649702s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:26.425422800 (106h40m20.856502931s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 04:06:26.904696973 (106h40m21.335777114s) [seg_pos={0 0}, upload=111021]: Begin upload segment... Aug 13 04:06:26.904765795 (106h40m21.335845926s) [seg_pos={0 0}, upload=111021]: Done begin upload segment. Aug 13 04:06:26.904790663 (106h40m21.335870824s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.904802375 (106h40m21.335882506s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905203663 (106h40m21.336283794s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905280250 (106h40m21.336360381s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905632202 (106h40m21.336712334s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.905977053 (106h40m21.337057174s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906235437 (106h40m21.337315568s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906450819 (106h40m21.33753095s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906655601 (106h40m21.337735732s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.906903746 (106h40m21.337983887s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907108547 (106h40m21.338188678s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907306706 (106h40m21.338386837s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907513452 (106h40m21.338593583s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.907881186 (106h40m21.338961317s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908101247 (106h40m21.339181388s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908297151 (106h40m21.339377282s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.908538153 (106h40m21.339618284s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:26.909131799 (106h40m21.34021193s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Uploading piece... Aug 13 04:06:28.021601497 (106h40m22.452681628s) [upload=111021]: Next returned nil segment Aug 13 04:06:28.021615003 (106h40m22.452695134s) [upload=111021]: Waiting for error group managing segments... Aug 13 04:06:28.337292921 (106h40m22.768373052s) [noise=true , address=66.23.193.175:4555 , piece_id=4N2I5KROXZTQ5OTC6ZYAAAABHHQD2YZYAFUHANY2CT7WGG7W4DJQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.337529053 (106h40m22.768609184s) [noise=true , address=64.49.13.140:4505 , piece_id=DJ5QHGHYOWYAB6GRB2D4UPIMZ3J6KBGR33LOMWLV653N3TBFBE4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.444001501 (106h40m22.875081632s) [noise=true , address=64.49.13.140:4513 , piece_id=XXJPDVHFXVZVF4VATXVSSIMFQGFU7AGLJLC2G4EFRMGA6NWERLMA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.882606711 (106h40m23.313686842s) [noise=true , address=77.90.31.11:4563 , piece_id=4D5MFIB3OTSTOBGT2JITLB66MIH6UY6X56CVRD7DNDCIDSIQXTZQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.886099483 (106h40m23.317179614s) [noise=true , address=77.90.31.18:4822 , piece_id=2ITEFASMCA24IMCH6BEBZZXNMFIJIG6FPEKHTN43COXUD6KPGSWQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.892480111 (106h40m23.323560252s) [noise=true , address=77.90.31.10:4552 , piece_id=VJWIVNGW6AUNMODRHCULLACEARMGHSHBHIXNVL2AXCCVPRD6HAEA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.909776295 (106h40m23.340856426s) [noise=true , address=104.36.82.46:4491 , piece_id=NP4NQTWJXXYKZ4LWSZD4TQRX3GSYRI62Q6QENA3LFWROMPYGVW4A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.912305053 (106h40m23.343385174s) [noise=true , address=104.36.82.8:4996 , piece_id=GAV7GZWNYKXWRHIVUZDJCLWIFTD4HYTTXPQVEEQTPAU3OAKMHT3A, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.914882385 (106h40m23.345962516s) [noise=true , address=104.36.82.23:4456 , piece_id=77FJETPT3RKXRLHKSUBSWVIF6ZXPNDM7APABMGW5YB5NN44JK2VQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.916707126 (106h40m23.347787257s) [noise=true , address=77.90.31.16:4762 , piece_id=6F36G3TQ4WOB2FFZ4OCZLD254O6EVKBNZRWRNMTT3XAQZNOE43LA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.918119980 (106h40m23.349200111s) [noise=true , address=77.90.31.13:4654 , piece_id=XFPOB337CZMC43Z5A34JJOM24YVLKP5EXY23Y3UFCA26PKG7VLCQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.931546700 (106h40m23.362626831s) [noise=true , address=77.90.31.19:4872 , piece_id=JYU7BIM3I3LGCOMLAUHLUFFGIVWWPF5PSMUICZQSK3E4K2UF4RHA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.951933947 (106h40m23.383014078s) [noise=true , address=104.36.82.34:4577 , piece_id=YNOBONB5R3Z7MNZTAQC7GQWXXXU3HO3JLGPA442PBLF4RPRPDBRQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964905295 (106h40m23.395985427s) [noise=true , address=104.36.82.38:4694 , piece_id=TDOWHTUCLCEIFRXGLFMYBXQIOE5TEEZBYFGZBT7RYS53OSOIPRMQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: <nil> Aug 13 04:06:28.964925074 (106h40m23.396005205s) [seg_pos={0 0}, upload=111021]: Segment reached optimal threshold of 14 pieces. Aug 13 04:06:28.965067476 (106h40m23.396147607s) [noise=true , address=104.36.82.62:4434 , piece_id=46RGZKR7LBJHQEXP7USVN64LSDDIQTBA7EVMOF2C53D34555VZDA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965125707 (106h40m23.396205838s) [noise=true , address=104.36.82.18:4390 , piece_id=5U5K2RWLFPFD5F3CNWFUKA73F2MB4T5Y3IUU3JEFT2HAAOI73MWA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AZCJHCR7rF4r62Bg7NcBkpNoLb6r6rEN2a5hZ9KNxJTtjV8jp): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965179801 (106h40m23.396259932s) [noise=true , address=79.127.220.97:4367 , piece_id=IAI3BQS7LFHBXSAQTKUAV3PNJBH7RJYHZOOBC54QWKJFJ3EGA3FA, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ukTBGQCf81aFiZhST9sqJEN28d1qg44gv27U2oPJKiGNirRPB): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965229646 (106h40m23.396309777s) [noise=true , address=104.36.82.5:4863 , piece_id=VDW6ZUI6FKVCN3AGS3W33U536FQAPJY6EYNNR6EKORK7ACKLABAQ, seg_pos={0 0}, upload=111021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ApjPajPXNsWuwWvZ778CTxL33xrFi2cebEDBNHhFa52Nm2aqn): protocol: expected piece hash; context canceled; EOF Aug 13 04:06:28.965240907 (106h40m23.396321038s) [seg_pos={0 0}, upload=111021]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 04:06:28.965352811 (106h40m23.396432942s) [upload=111021]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 04:06:28.965357411 (106h40m23.396437542s) [upload=111021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.262537166 (106h40m23.693617287s) [upload=111021]: Done uploading segments... Aug 13 04:06:29.262553186 (106h40m23.693633317s) [upload=111021]: Upload finished. err: <nil> Duration: 5.702131578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 854.429862ms FAIL (2025-08-13 04:06:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:06:28.886174657 (106h40m23.317254789s) [upload=111024]: Starting upload Aug 13 04:06:28.886252246 (106h40m23.317332377s) [upload=111024]: Done starting upload Aug 13 04:06:28.886313894 (106h40m23.317394025s) [upload=111024]: Uploading segments... Aug 13 04:06:28.886365292 (106h40m23.317445423s) [upload=111024]: Got next segment. Inline: true Aug 13 04:06:28.886369460 (106h40m23.317449591s) [upload=111024]: Waiting for error group managing segments... Aug 13 04:06:28.886416100 (106h40m23.317496231s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 04:06:28.886420428 (106h40m23.317500559s) [upload=111024]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 04:06:28.886423073 (106h40m23.317503204s) [upload=111024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 04:06:29.098547387 (106h40m23.529627519s) [upload=111024]: Done uploading segments... Aug 13 04:06:29.098562367 (106h40m23.529642488s) [upload=111024]: Upload finished. err: metaclient: Too Many Requests Duration:* 854.444811ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.843478426s FAIL (2025-08-13 04:05:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.843513464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X............................X.....................] duration: 5.784447695s FAIL (2025-08-13 04:05:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.784469967s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 7.823736269s FAIL (2025-08-13 04:05:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.823753351s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X............................X....................] duration: 5.988067531s FAIL (2025-08-13 04:04:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.988103862s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 7.73074852s FAIL (2025-08-13 04:04:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.730772106s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.825287961s FAIL (2025-08-13 04:04:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.825321254s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X............................X...................] duration: 5.643153285s FAIL (2025-08-13 04:04:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.643171801s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 8.547551608s FAIL (2025-08-13 04:04:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.547574292s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.213224483s FAIL (2025-08-13 04:03:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.213252245s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 12.497857767s FAIL (2025-08-13 04:03:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.497883547s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X............................X..................] duration: 6.129310285s FAIL (2025-08-13 04:03:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.129337517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.844805746s FAIL (2025-08-13 04:02:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.8448387s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 8.259117497s FAIL (2025-08-13 04:02:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.25914015s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.098379368s FAIL (2025-08-13 04:02:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.098412281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 7.678321416s FAIL (2025-08-13 04:02:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.678343498s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X............................X.................] duration: 5.721600331s FAIL (2025-08-13 04:01:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.721628554s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.837311397s FAIL (2025-08-13 04:01:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.837347466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................X................] duration: 6.072970893s FAIL (2025-08-13 04:01:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.072996141s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.092369318s FAIL (2025-08-13 04:01:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.092402661s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X............................X...............] duration: 5.98951478s FAIL (2025-08-13 04:00:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.989550448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 7.999592106s FAIL (2025-08-13 04:00:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.999615911s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.944991624s FAIL (2025-08-13 04:00:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.945016511s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X............................X..............] duration: 6.062374414s FAIL (2025-08-13 04:00:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.062391668s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.873320473s FAIL (2025-08-13 04:00:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.873355519s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.....XX....................................................] duration: 7.440049997s FAIL (2025-08-13 03:59:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.440072079s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.....XX...................................................] duration: 7.707075079s FAIL (2025-08-13 03:59:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.707264892s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.88306005s FAIL (2025-08-13 03:59:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.883092471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X............................X.............] duration: 5.845375452s FAIL (2025-08-13 03:59:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.845394077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.....XX..................................................] duration: 7.611347342s FAIL (2025-08-13 03:59:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.611395775s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X............................X............] duration: 5.911056353s FAIL (2025-08-13 03:59:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.911082283s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.048585185s FAIL (2025-08-13 03:58:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.048610091s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.....XX.................................................] duration: 11.179917059s FAIL (2025-08-13 03:58:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 11.179935424s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X............................X...........] duration: 5.787359773s FAIL (2025-08-13 03:58:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.78738905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.....XX................................................] duration: 7.620825273s FAIL (2025-08-13 03:57:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.620846323s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...................X............................X..........] duration: 5.91557302s FAIL (2025-08-13 03:57:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.915600953s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.912869936s FAIL (2025-08-13 03:57:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.912897658s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...................X............................X.........] duration: 6.379246029s FAIL (2025-08-13 03:57:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 6.379292878s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.....XX...............................................] duration: 10.582131582s FAIL (2025-08-13 03:57:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.58215717s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.949502125s FAIL (2025-08-13 03:56:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:23:34.987469695 (105h57m29.418549826s) [upload=110284]: Starting upload Aug 13 03:23:34.987520002 (105h57m29.418600133s) [upload=110284]: Done starting upload Aug 13 03:23:34.987570067 (105h57m29.418650198s) [upload=110284]: Uploading segments... Aug 13 03:23:34.987604243 (105h57m29.418684374s) [upload=110284]: Got next segment. Inline: true Aug 13 03:23:34.987608641 (105h57m29.418688772s) [upload=110284]: Waiting for error group managing segments... Aug 13 03:23:34.987640973 (105h57m29.418721094s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:23:34.987644710 (105h57m29.418724841s) [upload=110284]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:23:34.987647044 (105h57m29.418727165s) [upload=110284]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:23:35.199946062 (105h57m29.631026193s) [upload=110284]: Done uploading segments... Aug 13 03:23:35.199964076 (105h57m29.631044207s) [upload=110284]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.949529708s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X............................X........] duration: 5.663525376s FAIL (2025-08-13 03:56:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:49:53.308968726 (106h23m47.740048857s) [upload=110735]: Starting upload Aug 13 03:49:53.309015837 (106h23m47.740095968s) [upload=110735]: Done starting upload Aug 13 03:49:53.309101450 (106h23m47.740181612s) [upload=110735]: Uploading segments... Aug 13 03:49:53.309234645 (106h23m47.740314807s) [upload=110735]: Got next segment. Inline: false Aug 13 03:49:53.309324146 (106h23m47.740404328s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:49:53.309331712 (106h23m47.740411893s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:49:53.766008247 (106h23m48.197088378s) [seg_pos={0 0}, upload=110735]: Begin upload segment... Aug 13 03:49:53.766052361 (106h23m48.197132482s) [seg_pos={0 0}, upload=110735]: Done begin upload segment. Aug 13 03:49:53.766070065 (106h23m48.197150196s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766080134 (106h23m48.197160255s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766457186 (106h23m48.197537317s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766492693 (106h23m48.197572814s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.766771638 (106h23m48.197851769s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.767178185 (106h23m48.198258316s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768376348 (106h23m48.199456479s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768871976 (106h23m48.199952107s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.768886523 (106h23m48.199966655s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769341765 (106h23m48.200421896s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.769732592 (106h23m48.200812724s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770050361 (106h23m48.201130492s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770315267 (106h23m48.201395398s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770557250 (106h23m48.201637371s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.770700696 (106h23m48.201780837s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771050183 (106h23m48.202130315s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771365317 (106h23m48.202445448s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:53.771616087 (106h23m48.202696218s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Uploading piece... Aug 13 03:49:54.879746695 (106h23m49.310826816s) [upload=110735]: Next returned nil segment Aug 13 03:49:54.879761273 (106h23m49.310841394s) [upload=110735]: Waiting for error group managing segments... Aug 13 03:49:55.174383545 (106h23m49.605463676s) [noise=true , address=64.49.13.169:4714 , piece_id=VXCS4DXR3VJCGXL4F4KZXBHN7PPJUVZITJ3HYRN6SPWIPYXSMYPA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.726978445 (106h23m50.158058576s) [noise=true , address=104.36.82.35:4602 , piece_id=ZXQQNNRNWYUIRDK7PAGSRGS2QPB2AEFBD6GUEOFY7DFJDO6HVJDA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.730580046 (106h23m50.161660167s) [noise=true , address=77.90.31.13:4643 , piece_id=YP4TPPDWZ7II2YCKOZOEQGVQMNVUZ74E27YBOKSSC6RICQWCCECA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.733558084 (106h23m50.164638215s) [noise=true , address=104.36.82.37:4682 , piece_id=ZXQFTSV24YGFLNKIMYCDVGMDPFGQZAIW6QPC2Z5WWRU4LMWP2UVA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.755909440 (106h23m50.186989571s) [noise=true , address=104.36.82.5:4853 , piece_id=TQF7HVLW7FY2OL5Z4CPV3OFFBMPDQUFP5A25CJW6UR7NLHBKAIBA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.758609305 (106h23m50.189689436s) [noise=true , address=77.90.31.12:4618 , piece_id=K2VN2PA3EG6YQL4Q4YBMBQEGC4SOSYDAF57LO3YFMYQ37RROUXOQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.760733891 (106h23m50.191814022s) [noise=true , address=104.36.82.59:4316 , piece_id=UTVPQPZQXEGGN3WTLXSLLG5YKINNKAW3GDYVVGIMETIUWJ722VYA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.766054742 (106h23m50.197134873s) [noise=true , address=77.90.31.18:4822 , piece_id=4ICKC4PJKD6H4CNOAS4WOMZKEFDJ6JZMRBETBZZMAM5Y3LAGQ5NA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.781322423 (106h23m50.212402604s) [noise=true , address=104.36.82.42:4804 , piece_id=EMN2BEBRBPKDXECQUD7KCGQGYN2EEXINWILWEFISLQC23OHNRB4Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.803735116 (106h23m50.234815247s) [noise=true , address=104.36.82.11:4148 , piece_id=NJM4JWKBUBEALTKWNO5OXT4OAC2UABQ5KHUIFTQFVHPT2H6IPX3Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.814330439 (106h23m50.24541057s) [noise=true , address=104.36.82.58:4297 , piece_id=PTHXANV2VCJABYLKRWROSZBDVZZN7TZJIMK4GXWWS5WSF6J7ZO6A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.841839132 (106h23m50.272919253s) [noise=true , address=104.36.82.62:4440 , piece_id=NNRH5KZNUVQQMMB7Q532YKHYVILFLXUSGXPHKS6Q2H4ISM6BU55Q, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.860024787 (106h23m50.291104918s) [noise=true , address=104.36.82.36:4648 , piece_id=M5PJF2D2QSL6FFJMCONFLCUY7GQCLONGV5XAMKJPSRVAUXXAHIKQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879951554 (106h23m50.311031675s) [noise=true , address=104.36.82.60:4353 , piece_id=45W3E35Z3NWEJY4RYMSF6XLOB2IMSYTA2LPGW37JCV3OP5YODWWA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: <nil> Aug 13 03:49:55.879986100 (106h23m50.311066231s) [seg_pos={0 0}, upload=110735]: Segment reached optimal threshold of 14 pieces. Aug 13 03:49:55.880105158 (106h23m50.311185289s) [noise=true , address=104.36.82.23:4475 , piece_id=GK7HYW44D6DIMEYX4KCPS6JHRQTIEDW2ROEI3MHA7EI2KXM555KQ, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880168159 (106h23m50.31124829s) [noise=true , address=79.127.201.215:4349 , piece_id=LF3BZJW4MY36VLQGMKZ3TYC2BHWFOPHO4DVAUE5CUDV4RN2CXX7A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880217973 (106h23m50.311298104s) [noise=true , address=104.36.82.23:4451 , piece_id=IPJH7NABQEDR2A5AQ2VYYMBVMZI5BUHGZTF4KP6M4GTSIKQOPR3A, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880250767 (106h23m50.311330898s) [noise=true , address=79.127.219.38:4036 , piece_id=5JVQOKDLXPABT3CCZBCM7DGXVZYKWMWAQHPETXPA2PSQ4UN5SLAA, seg_pos={0 0}, upload=110735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DgDXbxPwDCoCgvrRwPxtopfsU5GzqqCtmKRHRVZmVndb1wVrm): protocol: expected piece hash; context canceled; EOF Aug 13 03:49:55.880282638 (106h23m50.311362769s) [seg_pos={0 0}, upload=110735]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:49:55.880377539 (106h23m50.31145766s) [upload=110735]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:49:55.880382067 (106h23m50.311462198s) [upload=110735]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:49:56.200392606 (106h23m50.631472737s) [upload=110735]: Done uploading segments... Aug 13 03:49:56.200410511 (106h23m50.631490642s) [upload=110735]: Upload finished. err: <nil> Duration: 5.663600339s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)