Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X.......X.....................X..............X.....] duration: 1.95856843s FAIL (2025-08-13 00:38:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.958593098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X..................X......X............................] duration: 5.863573076s FAIL (2025-08-13 00:37:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.86361641s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X..................X......X...........................] duration: 6.044487292s FAIL (2025-08-13 00:37:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.044514313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X..................X......X..........................] duration: 6.043210628s FAIL (2025-08-13 00:37:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.043236727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X.......X.....................X..............X....] duration: 1.844932001s FAIL (2025-08-13 00:36:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.844955435s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X..................X......X.........................] duration: 5.812634207s FAIL (2025-08-13 00:36:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.812660809s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X.......X.....................X..............X...] duration: 1.844198266s FAIL (2025-08-13 00:36:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.844223165s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..................X......X........................] duration: 5.794358593s FAIL (2025-08-13 00:35:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.794386427s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X.......X.....................X..............X..] duration: 1.902821676s FAIL (2025-08-13 00:35:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.902845992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X.......X.....................X..............X.] duration: 1.858032314s FAIL (2025-08-13 00:35:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.858059256s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X..................X......X.......................] duration: 5.843228673s FAIL (2025-08-13 00:35:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.843273329s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X..................X......X......................] duration: 5.985437818s FAIL (2025-08-13 00:34:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.985463907s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X.......X.....................X..............X] duration: 861.329987ms FAIL (2025-08-13 00:33:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:33:54.556969727 (103h7m48.988049848s) [upload=107369]: Starting upload Aug 13 00:33:54.557021246 (103h7m48.988101377s) [upload=107369]: Done starting upload Aug 13 00:33:54.557083404 (103h7m48.988163535s) [upload=107369]: Uploading segments... Aug 13 00:33:54.557123681 (103h7m48.988203812s) [upload=107369]: Got next segment. Inline: true Aug 13 00:33:54.557128621 (103h7m48.988208752s) [upload=107369]: Waiting for error group managing segments... Aug 13 00:33:54.557165511 (103h7m48.988245642s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:33:54.557169769 (103h7m48.9882499s) [upload=107369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:33:54.557172184 (103h7m48.988252315s) [upload=107369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:33:54.769055784 (103h7m49.200135915s) [upload=107369]: Done uploading segments... Aug 13 00:33:54.769079239 (103h7m49.20015941s) [upload=107369]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.358569ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X..................X......X.....................] duration: 6.936717117s FAIL (2025-08-13 00:33:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.936745701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X..............X.......X.....................X..............] duration: 2.079255035s FAIL (2025-08-13 00:33:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.079273209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..................X......X....................] duration: 5.832746942s FAIL (2025-08-13 00:32:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.832779775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X..............X.......X.....................X.............] duration: 2.03355172s FAIL (2025-08-13 00:31:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.033576447s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..................X......X...................] duration: 6.45202562s FAIL (2025-08-13 00:31:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.452048783s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X..............X.......X.....................X............] duration: 2.110365122s FAIL (2025-08-13 00:31:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.110393685s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X..................X......X..................] duration: 6.144490706s FAIL (2025-08-13 00:31:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.144517586s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X..............X.......X.....................X...........] duration: 1.928989287s FAIL (2025-08-13 00:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.929018311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X..................X......X.................] duration: 6.132820205s FAIL (2025-08-13 00:30:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.13285392s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X..............X.......X.....................X..........] duration: 1.862870106s FAIL (2025-08-13 00:30:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.86291892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X..............X.......X.....................X.........] duration: 1.945609444s FAIL (2025-08-13 00:29:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.945647036s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..................X......X................] duration: 5.837517807s FAIL (2025-08-13 00:29:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.837542944s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X..............X.......X.....................X........] duration: 1.939358147s FAIL (2025-08-13 00:29:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.939388785s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X..............X.......X.....................X.......] duration: 1.952083504s FAIL (2025-08-13 00:28:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.952347899s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X..................X......X...............] duration: 5.96727177s FAIL (2025-08-13 00:28:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.967303451s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X..............X.......X.....................X......] duration: 1.975011523s FAIL (2025-08-13 00:27:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.975033556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [X........X..............X.......X.....................X.....] duration: 1.899441592s FAIL (2025-08-13 00:27:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.899485534s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X..................X......X..............] duration: 5.944388636s FAIL (2025-08-13 00:26:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.944419095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.X........X..............X.......X.....................X....] duration: 1.894555019s FAIL (2025-08-13 00:26:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.894578314s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X..................X......X.............] duration: 5.825331539s FAIL (2025-08-13 00:26:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.825356998s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..X........X..............X.......X.....................X...] duration: 1.914583961s FAIL (2025-08-13 00:25:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.914607166s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..................X......X............] duration: 6.209100358s FAIL (2025-08-13 00:25:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.209123191s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X........X..............X.......X.....................X..] duration: 1.935342614s FAIL (2025-08-13 00:24:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.935361099s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X..................X......X...........] duration: 5.869073597s FAIL (2025-08-13 00:24:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.869099627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..................X......X..........] duration: 6.003629037s FAIL (2025-08-13 00:24:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.003650267s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X........X..............X.......X.....................X.] duration: 1.996177359s FAIL (2025-08-13 00:23:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.996202867s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X..................X......X.........] duration: 5.925656446s FAIL (2025-08-13 00:23:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.925683819s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..................X......X........] duration: 5.810239543s FAIL (2025-08-13 00:22:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.810265263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X........X..............X.......X.....................X] duration: 852.53795ms FAIL (2025-08-13 00:22:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 00:22:38.429694875 (102h56m32.860774996s) [upload=107177]: Starting upload Aug 13 00:22:38.429742647 (102h56m32.860822778s) [upload=107177]: Done starting upload Aug 13 00:22:38.429834682 (102h56m32.860914823s) [upload=107177]: Uploading segments... Aug 13 00:22:38.429877144 (102h56m32.860957265s) [upload=107177]: Got next segment. Inline: true Aug 13 00:22:38.429881412 (102h56m32.860961533s) [upload=107177]: Waiting for error group managing segments... Aug 13 00:22:38.429914736 (102h56m32.860994867s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:22:38.429918994 (102h56m32.860999115s) [upload=107177]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:22:38.429921820 (102h56m32.861001951s) [upload=107177]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:22:38.641710256 (102h56m33.072790387s) [upload=107177]: Done uploading segments... Aug 13 00:22:38.641727199 (102h56m33.07280733s) [upload=107177]: Upload finished. err: metaclient: Too Many Requests Duration:* 852.560693ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.........................X..................X......X.......] duration: 5.860541614s FAIL (2025-08-13 00:22:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.8605657s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.........................X..................X......X......] duration: 6.310526579s FAIL (2025-08-13 00:22:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.310552239s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X........X..............X.......X.....................] duration: 1.934601103s FAIL (2025-08-13 00:21:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c1c3277aa37adb31a9c6365b298cdede51d6fe2f17e3653e7f9ae09df813fb17 != before 1ee2ef8d9b4df3b20c7bf9810940546eed8614cebe232f6c58a34f666dc6163d ======LOGS====== Aug 13 00:04:53.828499267 (102h38m48.259579398s) [upload=106866]: Starting upload Aug 13 00:04:53.828547109 (102h38m48.25962724s) [upload=106866]: Done starting upload Aug 13 00:04:53.828643232 (102h38m48.259723363s) [upload=106866]: Uploading segments... Aug 13 00:04:53.828688158 (102h38m48.25976828s) [upload=106866]: Got next segment. Inline: true Aug 13 00:04:53.828692246 (102h38m48.259772377s) [upload=106866]: Waiting for error group managing segments... Aug 13 00:04:53.828726852 (102h38m48.259806983s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:04:53.828730840 (102h38m48.259810971s) [upload=106866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:04:53.828733875 (102h38m48.259814006s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:04:54.137081986 (102h38m48.568162108s) [upload=106866]: Done uploading segments... Aug 13 00:04:54.137099911 (102h38m48.568180042s) [upload=106866]: Upload finished. err: <nil> Duration:* 1.934623196s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.........................X..................X......X.....] duration: 5.991786977s FAIL (2025-08-13 00:21:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.991816514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.........................X..................X......X....] duration: 5.738366493s FAIL (2025-08-13 00:20:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 5.738391753s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X........X..............X.......X....................] duration: 2.036227992s FAIL (2025-08-13 00:20:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c1c3277aa37adb31a9c6365b298cdede51d6fe2f17e3653e7f9ae09df813fb17 != before 1ee2ef8d9b4df3b20c7bf9810940546eed8614cebe232f6c58a34f666dc6163d ======LOGS====== Aug 13 00:04:53.828499267 (102h38m48.259579398s) [upload=106866]: Starting upload Aug 13 00:04:53.828547109 (102h38m48.25962724s) [upload=106866]: Done starting upload Aug 13 00:04:53.828643232 (102h38m48.259723363s) [upload=106866]: Uploading segments... Aug 13 00:04:53.828688158 (102h38m48.25976828s) [upload=106866]: Got next segment. Inline: true Aug 13 00:04:53.828692246 (102h38m48.259772377s) [upload=106866]: Waiting for error group managing segments... Aug 13 00:04:53.828726852 (102h38m48.259806983s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:04:53.828730840 (102h38m48.259810971s) [upload=106866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:04:53.828733875 (102h38m48.259814006s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:04:54.137081986 (102h38m48.568162108s) [upload=106866]: Done uploading segments... Aug 13 00:04:54.137099911 (102h38m48.568180042s) [upload=106866]: Upload finished. err: <nil> Duration:* 2.036256185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.........................X..................X......X...] duration: 6.687199887s FAIL (2025-08-13 00:20:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6a1ed4979a346bfae47564f9df5e6b5ed00ba72843482335cf7f16708130bcb1 != before ae9800121f1e394c9720054b7e4df4ac6f96fbbc86e8a8b526cc049c7e7fff45 ======LOGS====== Aug 13 00:18:08.204113111 (102h52m2.635193242s) [upload=107103]: Starting upload Aug 13 00:18:08.204162877 (102h52m2.635243008s) [upload=107103]: Done starting upload Aug 13 00:18:08.204256385 (102h52m2.635336536s) [upload=107103]: Uploading segments... Aug 13 00:18:08.204408727 (102h52m2.635488858s) [upload=107103]: Got next segment. Inline: false Aug 13 00:18:08.204461668 (102h52m2.635541789s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:18:08.204470014 (102h52m2.635550175s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 00:18:08.655060274 (102h52m3.086140395s) [seg_pos={0 0}, upload=107103]: Begin upload segment... Aug 13 00:18:08.655144916 (102h52m3.086225047s) [seg_pos={0 0}, upload=107103]: Done begin upload segment. Aug 13 00:18:08.655159423 (102h52m3.086239544s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655168371 (102h52m3.086248502s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655201063 (102h52m3.086281184s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655457734 (102h52m3.086537865s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655492951 (102h52m3.086573082s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655691702 (102h52m3.086771833s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655809908 (102h52m3.086890029s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.655911643 (102h52m3.086991774s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656093100 (102h52m3.087173231s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656131123 (102h52m3.087211254s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656346153 (102h52m3.087426285s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656350533 (102h52m3.087430664s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656662710 (102h52m3.087742841s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.656911045 (102h52m3.087991176s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657143791 (102h52m3.088223912s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.657736604 (102h52m3.088816735s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.658006441 (102h52m3.089086572s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:08.659250180 (102h52m3.090330301s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Uploading piece... Aug 13 00:18:09.788787298 (102h52m4.219867439s) [upload=107103]: Next returned nil segment Aug 13 00:18:09.788828076 (102h52m4.219908217s) [upload=107103]: Waiting for error group managing segments... Aug 13 00:18:10.071725589 (102h52m4.50280572s) [noise=true , address=64.49.13.169:4714 , piece_id=ZJNMF34OGEDT3RXTOPDGHUVKHN67SF2WKYVX6OTA2CCNU77RYFEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.120905148 (102h52m4.551985279s) [noise=true , address=79.127.205.245:4227 , piece_id=SNEMATKNTRHXH4JVA3VQY4BZRTH7MRCSWVXJRGXM4VYAUIIW2RYA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.133854875 (102h52m4.564934996s) [noise=true , address=64.49.13.155:4920 , piece_id=MP23DSJHOL4IS2OW25KJRWY526AKX3DSHFFK3V7J3OCROJHL4TSA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.645608592 (102h52m5.076688723s) [noise=true , address=104.36.82.39:4738 , piece_id=Z6EASHYG2BXO567GLIDRQ3C3T2PAA2SPKVLEMSO7UUHOGM3TO5RA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.657673096 (102h52m5.088753218s) [noise=true , address=104.36.82.46:4498 , piece_id=RHE6IFY6CL5TWOQZX4PHO2LSWZBFTYPW636ZHKOKRO7W7ZDCWG4A, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.668124995 (102h52m5.099205116s) [noise=true , address=104.36.82.62:4443 , piece_id=OTBGAAAXRE4MOXP425HZNNGICPAUVADIRH7DNXNRBUSBQJ4Z7CEA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.673168023 (102h52m5.104248164s) [noise=true , address=45.91.116.5:4314 , piece_id=VZR2GHWNWTYMIOSUBX57UKJEHOOPTXJEVEWA2PE3DPIL56LVOHWA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.682643413 (102h52m5.113723544s) [noise=true , address=104.36.82.61:4385 , piece_id=ECECQSUYSP6XWWVUQ6EFPIE6RBHYYRSJ5ETEPDQRIMGG2QRG5CTQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.702357062 (102h52m5.133437193s) [noise=true , address=104.36.82.38:4723 , piece_id=25SJHPZMOFUOSYGRBJ4LOL63ENLAS4XD7GZOZ76ESDYQTVXO3MGA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.706478689 (102h52m5.13755881s) [noise=true , address=77.90.31.12:4623 , piece_id=KDPUJVJYSYNDU32TB4K6NBGJ5XIY5FOLTOUKTR6ZE3G2DDMJBSDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.730771289 (102h52m5.16185142s) [noise=true , address=104.36.82.50:4018 , piece_id=2N4HIF56G5IB462O7M7KN5YVQNAKFFD3JGTQXIPSLBF72EUK2CDQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.735496100 (102h52m5.166576231s) [noise=true , address=104.36.82.17:4338 , piece_id=NXRZFD2CXFWU2RXTRYKN3SFVVIQHHAONJIKC2X3VHZ4VN5HFHSPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.742309937 (102h52m5.173390068s) [noise=true , address=104.36.82.4:4810 , piece_id=D4MP75CLJSAML5NXX4ITXNSMXZ2KOZB7EIU7UMYYUE34HY7AECKQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744828045 (102h52m5.175908176s) [noise=true , address=104.36.82.19:4405 , piece_id=MWE36ASGOTROSUN3DSIGPNHHCOXITE2OFHHXFQCWCADEMNKILIHA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: <nil> Aug 13 00:18:10.744856941 (102h52m5.175937072s) [seg_pos={0 0}, upload=107103]: Segment reached optimal threshold of 14 pieces. Aug 13 00:18:10.745017077 (102h52m5.176097208s) [noise=true , address=104.36.82.34:4551 , piece_id=WPC6ZFEXED5D6RGGEYUBI5UT235OA4HOZOSYZFSUU4RYTIDKOZMQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745090156 (102h52m5.176170287s) [noise=true , address=104.36.82.58:4280 , piece_id=FKCWTGAHUXDTXBR7QQ2PZDZG5WKEPYBJL4ZDTOJXDCBGTERQ2DPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgHaEFKK4CeGg4x3vywTuYfT3kmac31xqg2QpsahQNXmvjhW8): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745131857 (102h52m5.176211988s) [noise=true , address=104.36.82.44:4893 , piece_id=XR5VD4P56WK3JUI3VWFOV5GDC6K5XNG7V6DPWXZ4ESVBIQTQA5IQ, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745153016 (102h52m5.176233147s) [noise=true , address=77.90.31.16:4753 , piece_id=IDIK4GCP6TQ7L45G6FKRTBC3DTWKFMPJG4IVFFCLR3724TXYMPPA, seg_pos={0 0}, upload=107103]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MUzLDSzWMc3Eru4zGrH3yF7aGiEmfGvzfUTm9cKNagjytQ7bE): protocol: expected piece hash; context canceled; EOF Aug 13 00:18:10.745165721 (102h52m5.176245852s) [seg_pos={0 0}, upload=107103]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 00:18:10.745259019 (102h52m5.17633915s) [upload=107103]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 00:18:10.745264030 (102h52m5.176344151s) [upload=107103]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:18:11.205081454 (102h52m5.636161585s) [upload=107103]: Done uploading segments... Aug 13 00:18:11.205101914 (102h52m5.636182045s) [upload=107103]: Upload finished. err: <nil> Duration: 6.68722844s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X........X..............X.......X...................] duration: 1.895412939s FAIL (2025-08-13 00:20:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c1c3277aa37adb31a9c6365b298cdede51d6fe2f17e3653e7f9ae09df813fb17 != before 1ee2ef8d9b4df3b20c7bf9810940546eed8614cebe232f6c58a34f666dc6163d ======LOGS====== Aug 13 00:04:53.828499267 (102h38m48.259579398s) [upload=106866]: Starting upload Aug 13 00:04:53.828547109 (102h38m48.25962724s) [upload=106866]: Done starting upload Aug 13 00:04:53.828643232 (102h38m48.259723363s) [upload=106866]: Uploading segments... Aug 13 00:04:53.828688158 (102h38m48.25976828s) [upload=106866]: Got next segment. Inline: true Aug 13 00:04:53.828692246 (102h38m48.259772377s) [upload=106866]: Waiting for error group managing segments... Aug 13 00:04:53.828726852 (102h38m48.259806983s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 00:04:53.828730840 (102h38m48.259810971s) [upload=106866]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 00:04:53.828733875 (102h38m48.259814006s) [upload=106866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 00:04:54.137081986 (102h38m48.568162108s) [upload=106866]: Done uploading segments... Aug 13 00:04:54.137099911 (102h38m48.568180042s) [upload=106866]: Upload finished. err: <nil> Duration:* 1.89544487s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)