Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X................X.XX.....X...............X.................] duration:
5.505340796s
FAIL (2025-08-22 04:49:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.505378166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.831248179s
FAIL (2025-08-22 04:48:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.831272905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X................X.XX.....X...............X................] duration:
5.782353784s
FAIL (2025-08-22 04:48:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.782391815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.106687272s
FAIL (2025-08-22 04:47:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.106723522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X................X.XX.....X...............X...............] duration:
5.606494014s
FAIL (2025-08-22 04:47:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.606524993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X................X.XX.....X...............X..............] duration:
5.972293814s
FAIL (2025-08-22 04:47:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.972320374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.993728259s
FAIL (2025-08-22 04:47:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.993753217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X................X.XX.....X...............X.............] duration:
5.783689919s
FAIL (2025-08-22 04:46:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.78371609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.936159596s
FAIL (2025-08-22 04:46:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.93618165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.902810339s
FAIL (2025-08-22 04:45:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.902840886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X................X.XX.....X...............X............] duration:
5.673679877s
FAIL (2025-08-22 04:45:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.673704755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X................X.XX.....X...............X...........] duration:
5.740269891s
FAIL (2025-08-22 04:45:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.74030101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X................X.XX.....X...............X..........] duration:
5.752979495s
FAIL (2025-08-22 04:44:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.753004192s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.815877919s
FAIL (2025-08-22 04:44:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.815907205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X................X.XX.....X...............X.........] duration:
5.641981835s
FAIL (2025-08-22 04:43:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.642007946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.804446607s
FAIL (2025-08-22 04:43:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.804466606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.830070685s
FAIL (2025-08-22 04:43:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.830101225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X................X.XX.....X...............X........] duration:
5.662128022s
FAIL (2025-08-22 04:43:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.662157128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.817379551s
FAIL (2025-08-22 04:42:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.817411493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X................X.XX.....X...............X.......] duration:
5.796472057s
FAIL (2025-08-22 04:42:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.796495282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X................X.XX.....X...............X......] duration:
5.88132208s
FAIL (2025-08-22 04:41:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.881347568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.845210484s
FAIL (2025-08-22 04:41:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.845232097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............X................X.XX.....X...............X.....] duration:
5.819822965s
FAIL (2025-08-22 04:41:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.819864996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.822054998s
FAIL (2025-08-22 04:40:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.822075697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.938183659s
FAIL (2025-08-22 04:39:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.938218346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............X................X.XX.....X...............X....] duration:
5.762992858s
FAIL (2025-08-22 04:39:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.763022335s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X................X.XX.....X...............X...] duration:
5.789895844s
FAIL (2025-08-22 04:39:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.789924689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.929161724s
FAIL (2025-08-22 04:38:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.929181002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.992663141s
FAIL (2025-08-22 04:38:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.992691808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X................X.XX.....X...............X..] duration:
6.097182275s
FAIL (2025-08-22 04:38:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 6.097203947s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.045985718s
FAIL (2025-08-22 04:37:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.046005707s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X................X.XX.....X...............X.] duration:
5.610163323s
FAIL (2025-08-22 04:37:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.610180166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.951671219s
FAIL (2025-08-22 04:37:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.95169728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X................X................X.XX.....X...............X] duration:
5.80239526s
FAIL (2025-08-22 04:36:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8c776b58b68b8c504a8b7830b6ee354638c513b510573ba75098cdd67466088c != before d200c866f8fd3a9b77af5fb75067efea5c77b71ac02c47c39e8e7a2ecd2bf184
======LOGS======
Aug 22 04:36:52.937341723 (323h10m47.368421854s) [upload=336222]: Starting upload
Aug 22 04:36:52.937394073 (323h10m47.368474204s) [upload=336222]: Done starting upload
Aug 22 04:36:52.937593906 (323h10m47.368674037s) [upload=336222]: Uploading segments...
Aug 22 04:36:52.937644953 (323h10m47.368725084s) [upload=336222]: Got next segment. Inline: false
Aug 22 04:36:52.937669330 (323h10m47.368749461s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:36:52.937673458 (323h10m47.368753589s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:36:53.406296550 (323h10m47.837376681s) [seg_pos={0 0}, upload=336222]: Begin upload segment...
Aug 22 04:36:53.406347166 (323h10m47.837427297s) [seg_pos={0 0}, upload=336222]: Done begin upload segment.
Aug 22 04:36:53.406368697 (323h10m47.837448828s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406513434 (323h10m47.837593585s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.406815904 (323h10m47.837896035s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407092433 (323h10m47.838172564s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407137909 (323h10m47.83821804s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407363150 (323h10m47.838443281s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407589053 (323h10m47.838669184s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407600034 (323h10m47.838680165s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407809875 (323h10m47.838890006s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.407997454 (323h10m47.839077586s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408066486 (323h10m47.839146617s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408361350 (323h10m47.839441472s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408540633 (323h10m47.839620754s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408589427 (323h10m47.839669558s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408794660 (323h10m47.839874791s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.408881886 (323h10m47.839962018s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409214823 (323h10m47.840294954s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:53.409493947 (323h10m47.840574078s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Uploading piece...
Aug 22 04:36:54.871527354 (323h10m49.302607485s) [upload=336222]: Next returned nil segment
Aug 22 04:36:54.871549868 (323h10m49.302629999s) [upload=336222]: Waiting for error group managing segments...
Aug 22 04:36:55.279884443 (323h10m49.710964575s) [noise=true , address=45.91.116.11:4138 , piece_id=C2YD2LFUU2R5IYGSSLMKPGEG7Z346KXV56V7U5BB6TC7IPI5HELQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.331905510 (323h10m49.762985641s) [noise=true , address=79.127.220.97:4380 , piece_id=LV7TUV7DBQA7LAOOVT4U3LRVF55NTXEYVUDHCWX3RI2CY6VJOJLQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.353765908 (323h10m49.784846039s) [noise=true , address=77.90.31.19:4852 , piece_id=ZY3FSNF3H5V7553YBF3MFYXSPI6MV7TULQYR7VPDTDBYP7NPO6IA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.358145398 (323h10m49.789225529s) [noise=true , address=77.90.31.10:4522 , piece_id=FHWCEPW5KGQQQKQQFHBNJWHMRPE4TJWIUP4KQLTL2HVYDCPYCJYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.362368639 (323h10m49.79344876s) [noise=true , address=104.36.82.60:4351 , piece_id=EXQX2VU54CSF2N5Z543PIETSZZZFYRLGYJJYLDTWZOONZRJMLYDQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.363265655 (323h10m49.794345786s) [noise=true , address=79.127.201.215:4344 , piece_id=UBWX3F57GK6C3B6XKCNESOEBPY33TIRDSVRZCS5VAVOMYIP4NHNQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.385417209 (323h10m49.81649734s) [noise=true , address=104.36.82.13:4206 , piece_id=D4MIE6I4EIBZZYQHCG6I5FEHXXAZVEYMPFTZDNDKWW33RTFTZPCQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.387484184 (323h10m49.818564315s) [noise=true , address=79.127.201.215:4345 , piece_id=6UGIXDTRUY3UN6ZIETYZMEXYZECRTPEJNTOL65OWHM77EPIWGZEQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.390624473 (323h10m49.821704594s) [noise=true , address=77.90.31.11:4561 , piece_id=ROFNZD5SMJZSCFRKJ3JW7HMTEECJCYOS5WJJN5VBDHZ53QTGECYQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.392926367 (323h10m49.824006488s) [noise=true , address=104.36.82.51:4074 , piece_id=OPNGOCCGKHFGOWT2L2SLICW46RTV7ZQKPA3ZKGLLVFJB2RQ6N62A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.400920584 (323h10m49.832000715s) [noise=true , address=45.91.116.5:4316 , piece_id=JXJFZUTKMSEMWR34RTZHRYWH5NA4E3SDHEFJVM6TVKWZ6VV4427A, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.416908935 (323h10m49.847989076s) [noise=true , address=45.91.116.10:4112 , piece_id=7ZAPVAWZCPBNDT7376MV7Q43OZMQHLBCJF2NZCLIUSQFWC42WP6Q, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.417131801 (323h10m49.848211932s) [noise=true , address=104.36.82.4:4817 , piece_id=LI3BGKNE7UKHGTVIPVHDYR5DDXCK6VVVNDJUCSLJVFHPN2QKARKQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421112118 (323h10m49.852192239s) [noise=true , address=77.90.31.15:4722 , piece_id=6AFYNWFAV2BM4Y7SZJJILDMKDANBMYY24RXZ54X5GVNSE24FLTGA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: <nil>
Aug 22 04:36:55.421137938 (323h10m49.852218069s) [seg_pos={0 0}, upload=336222]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:36:55.421277715 (323h10m49.852357846s) [noise=true , address=77.90.31.13:4645 , piece_id=L24ZYMO76JFGYE3Z7AV43EQIKUHAHUTGBYVIACCWE4MQ25T6T5SQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421355935 (323h10m49.852436066s) [noise=true , address=77.90.31.17:4780 , piece_id=PRAKOJRPIA6JS2XWIONTMQY7VMQAP54FRL6CQMDU7H5HVZ2HBRXA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421375441 (323h10m49.852455572s) [noise=true , address=45.91.116.13:4172 , piece_id=G6J4BLG3QDPWPVVYUPH4SXAUQFA7ZNGNYAPELM65OU5EBCYZMJTQ, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mGtFKf4tj7HsTRDunxBQw4WtsSqzv4wBhDExqC64qoSUSPhG5): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421404747 (323h10m49.852484878s) [noise=true , address=77.90.31.18:4818 , piece_id=SFZQFQV2IJ4D4OCQ6C7U7DUPDGH5MSHYHJOH2W7DUDB7LZCQKLRA, seg_pos={0 0}, upload=336222]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6): protocol: expected piece hash; context canceled; EOF
Aug 22 04:36:55.421417673 (323h10m49.852497804s) [seg_pos={0 0}, upload=336222]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:36:55.421474772 (323h10m49.852554903s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:36:55.421478609 (323h10m49.85255873s) [upload=336222]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:36:55.728381506 (323h10m50.159461637s) [upload=336222]: Done uploading segments...
Aug 22 04:36:55.728398468 (323h10m50.159478599s) [upload=336222]: Upload finished. err: <nil>
Duration: 5.802425967s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.843838785s
FAIL (2025-08-22 04:36:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.843865846s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X................X................X.XX.....X...............] duration:
5.910651696s
FAIL (2025-08-22 04:36:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.910677315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X................X................X.XX.....X..............] duration:
5.79588936s
FAIL (2025-08-22 04:36:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.795916102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X................X................X.XX.....X.............] duration:
5.856292317s
FAIL (2025-08-22 04:35:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.856312604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.88266805s
FAIL (2025-08-22 04:35:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.882699541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X................X................X.XX.....X............] duration:
5.950995493s
FAIL (2025-08-22 04:34:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.951021101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.991854486s
FAIL (2025-08-22 04:34:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.991886918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X................X................X.XX.....X...........] duration:
5.840988904s
FAIL (2025-08-22 04:34:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.841014582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.875108557s
FAIL (2025-08-22 04:33:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875140978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X................X................X.XX.....X..........] duration:
5.523267078s
FAIL (2025-08-22 04:33:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.523318996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X................X................X.XX.....X.........] duration:
5.773520971s
FAIL (2025-08-22 04:33:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.773597017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.841811323s
FAIL (2025-08-22 04:32:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841839918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X................X................X.XX.....X........] duration:
6.000410523s
FAIL (2025-08-22 04:32:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 6.000438958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.822987366s
FAIL (2025-08-22 04:31:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.823014068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X........X................X................X.XX.....X.......] duration:
5.592984344s
FAIL (2025-08-22 04:31:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 04:24:48.096299446 (322h58m42.527379617s) [upload=336004]: Starting upload
Aug 22 04:24:48.096387925 (322h58m42.527468056s) [upload=336004]: Done starting upload
Aug 22 04:24:48.096452508 (322h58m42.527532679s) [upload=336004]: Uploading segments...
Aug 22 04:24:48.096792158 (322h58m42.527872309s) [upload=336004]: Got next segment. Inline: false
Aug 22 04:24:48.096842505 (322h58m42.527922676s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 04:24:48.096850430 (322h58m42.527930631s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 04:24:48.547727917 (322h58m42.978808038s) [seg_pos={0 0}, upload=336004]: Begin upload segment...
Aug 22 04:24:48.547777622 (322h58m42.978857753s) [seg_pos={0 0}, upload=336004]: Done begin upload segment.
Aug 22 04:24:48.547798743 (322h58m42.978878874s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.547807890 (322h58m42.978888021s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548204089 (322h58m42.97928422s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548486699 (322h58m42.97956683s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.548762086 (322h58m42.979842217s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549049526 (322h58m42.980129657s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549345091 (322h58m42.980425222s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549587415 (322h58m42.980667546s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.549815091 (322h58m42.980895222s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550040152 (322h58m42.981120283s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.550242739 (322h58m42.98132287s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551026830 (322h58m42.982106961s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.551559759 (322h58m42.9826399s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552076217 (322h58m42.983156358s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552419023 (322h58m42.983499144s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552641548 (322h58m42.983721679s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.552838937 (322h58m42.983919068s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:48.553032547 (322h58m42.984112678s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Uploading piece...
Aug 22 04:24:50.010770267 (322h58m44.441850398s) [upload=336004]: Next returned nil segment
Aug 22 04:24:50.010788582 (322h58m44.441868713s) [upload=336004]: Waiting for error group managing segments...
Aug 22 04:24:50.384809062 (322h58m44.815889193s) [noise=true , address=79.127.220.97:4380 , piece_id=5LGIHQCHRJU3BNNFVVZUJ7Q2KSP4SJU5B27PU6B6CNQBACG5OVNQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.421655934 (322h58m44.852736065s) [noise=true , address=45.91.116.13:4180 , piece_id=CETTUF7E7ORC63OLUI7VHYAMRHINK2WSEGI7YAYWJC7Z4QGPJC4A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.437657621 (322h58m44.868737752s) [noise=true , address=79.127.219.48:4100 , piece_id=FENDV4B2SQBLQEAE3BL2DT74OCJZOGJMDWTN5CFQYXMPMPWGW6YA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.438914927 (322h58m44.869995058s) [noise=true , address=45.91.116.10:4106 , piece_id=U7MU7TEAGOIZ7JLCHPG4OAFVOXZ5EM2E3FKZWWCDH2JX7BZEOL6A, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.447239555 (322h58m44.878319686s) [noise=true , address=45.91.116.8:4059 , piece_id=M7532VIE44I7SMRJE76ZVAMMLGKVR6SKSQPZ6AB6OXIKNBKGUNDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.458304767 (322h58m44.889384898s) [noise=true , address=45.91.116.8:4052 , piece_id=FGGTQPNRI54I46J6JUYA46Y76YHCEKM3PQMJZO3B3YGCIDI65ENQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.466692336 (322h58m44.897772517s) [noise=true , address=79.127.219.51:4213 , piece_id=LJB6I7VUUC3W2EITHSJT5A5UYJX63UCFFM7VRBAAIHTBTAFEU2RA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.473827518 (322h58m44.904907649s) [noise=true , address=104.36.82.60:4339 , piece_id=57GHT5WYYHF4CIC5Z2JICYWQRTO4LAJPQMYRY7VTXHJWNYMEO5CQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.480317697 (322h58m44.911397828s) [noise=true , address=77.90.31.21:4891 , piece_id=4BKSMK3KCISFBIG2VH4USRZAPNZO653WYGK27MR6562VSONCQFWQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.485693673 (322h58m44.916773804s) [noise=true , address=79.127.219.47:4050 , piece_id=SNX5LCU5E26FJ25DXMVVJZNCNNGQCRK3XLXQINT6M2CEZQ4PQAXQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.521659940 (322h58m44.952740071s) [noise=true , address=77.90.31.13:4656 , piece_id=DVTG555X4OITFEUOHAXSCEXZ226HXVUUPA4MVGKNK7WVFSXF27XA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.546334664 (322h58m44.977414795s) [noise=true , address=77.90.31.18:4816 , piece_id=ZAV4AZUCIPAQTVITZ4PPKPTSZ7EMUPOSFUZD7UCLLXOSQKFMQVQA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.556986314 (322h58m44.988066435s) [noise=true , address=77.90.31.11:4558 , piece_id=CKRUYVIA2WZXJHFYR5VYTH57UGMYGQ2TIEKIPUC5MKGJCN4FEIMA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598852771 (322h58m45.029932902s) [noise=true , address=77.90.31.16:4751 , piece_id=MVTD6PJO6W3YTIHE3YWFCAEHG33DJJF3EAYCPS77JGV4JDAOUDOA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: <nil>
Aug 22 04:24:50.598879843 (322h58m45.029959974s) [seg_pos={0 0}, upload=336004]: Segment reached optimal threshold of 14 pieces.
Aug 22 04:24:50.598994812 (322h58m45.030074934s) [noise=true , address=104.36.82.23:4457 , piece_id=VZ2MP4LHLI2RESLULUQNNXRF6XC6OXCKBGXII3E5JR243DARAVDA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mpuVB9gpUQ6dNLaMAVaDkgctVSetSbPRxhxU49WhAzycwwNhs): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599054417 (322h58m45.030134538s) [noise=true , address=45.91.116.14:4201 , piece_id=RVNPRWQ34A4I67MTPC7W3B4RT5MKY6OHW55SGVYFGKQGMPCECQRA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RUqtJWMppPz7u7bTYm5chvDf53HVDPCwC7bnmTs1R5hJD8Chp): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599103380 (322h58m45.030183511s) [noise=true , address=77.90.31.15:4707 , piece_id=UNIJF6YSXNNKN2PCT5ATCWRRSYOFIOVX7QLR2J5MWXH72ELVOSIQ, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599139149 (322h58m45.03021928s) [noise=true , address=104.36.82.5:4866 , piece_id=YYZ5WCFPAYLKUMZUEDH5QJ4UVUJJPTVVKQWJR6LEZEJTNDAVOPEA, seg_pos={0 0}, upload=336004]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: expected piece hash; context canceled; EOF
Aug 22 04:24:50.599178504 (322h58m45.030258635s) [seg_pos={0 0}, upload=336004]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 04:24:50.599259910 (322h58m45.030340031s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 04:24:50.599264699 (322h58m45.03034483s) [upload=336004]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 04:24:51.002941733 (322h58m45.434021874s) [upload=336004]: Done uploading segments...
Aug 22 04:24:51.002961321 (322h58m45.434041452s) [upload=336004]: Upload finished. err: <nil>
Duration: 5.593013048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.854077595s
FAIL (2025-08-22 04:31:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 04:22:29.107755365 (322h56m23.538835546s) [upload=335969]: Starting upload Aug 22 04:22:29.107857801 (322h56m23.538937922s) [upload=335969]: Done starting upload Aug 22 04:22:29.107950268 (322h56m23.539030389s) [upload=335969]: Uploading segments... Aug 22 04:22:29.107996266 (322h56m23.539076387s) [upload=335969]: Got next segment. Inline: true Aug 22 04:22:29.108000875 (322h56m23.539080996s) [upload=335969]: Waiting for error group managing segments... Aug 22 04:22:29.108037074 (322h56m23.539117205s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 04:22:29.108041803 (322h56m23.539121934s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 04:22:29.108044287 (322h56m23.539124419s) [upload=335969]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 04:22:29.321031647 (322h56m23.752111778s) [upload=335969]: Done uploading segments... Aug 22 04:22:29.321048179 (322h56m23.75212831s) [upload=335969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854108724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|