Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.996240403s
FAIL (2025-08-17 11:26:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.996273045s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.911296631s
FAIL (2025-08-17 11:26:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.911326089s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X.....................X.........X............X....] duration:
5.623637056s
FAIL (2025-08-17 11:26:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:22:55.189100230 (209h56m49.620180351s) [upload=218362]: Starting upload
Aug 17 11:22:55.189140047 (209h56m49.620220178s) [upload=218362]: Done starting upload
Aug 17 11:22:55.189341442 (209h56m49.620421573s) [upload=218362]: Uploading segments...
Aug 17 11:22:55.189370848 (209h56m49.620450979s) [upload=218362]: Got next segment. Inline: false
Aug 17 11:22:55.189398130 (209h56m49.620478291s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:22:55.189407478 (209h56m49.620487679s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:22:55.657453970 (209h56m50.088534101s) [seg_pos={0 0}, upload=218362]: Begin upload segment...
Aug 17 11:22:55.657514747 (209h56m50.088594878s) [seg_pos={0 0}, upload=218362]: Done begin upload segment.
Aug 17 11:22:55.657548521 (209h56m50.088628652s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.657906125 (209h56m50.088986256s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658039881 (209h56m50.089120012s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658243060 (209h56m50.089323181s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658410380 (209h56m50.089490511s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658526211 (209h56m50.089606342s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658798582 (209h56m50.089878713s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658813171 (209h56m50.089893302s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659089890 (209h56m50.090170021s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659134294 (209h56m50.090214425s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659357042 (209h56m50.090437173s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659446733 (209h56m50.090526864s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659616197 (209h56m50.090696328s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659758128 (209h56m50.090838259s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659887426 (209h56m50.090967557s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660060547 (209h56m50.091140678s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660083521 (209h56m50.091163652s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660415346 (209h56m50.091495467s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:56.858432922 (209h56m51.289513053s) [upload=218362]: Next returned nil segment
Aug 17 11:22:56.858449834 (209h56m51.289529955s) [upload=218362]: Waiting for error group managing segments...
Aug 17 11:22:57.161106823 (209h56m51.592186965s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.563532459 (209h56m51.99461259s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.570030000 (209h56m52.001110131s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.571838611 (209h56m52.002918732s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.572295065 (209h56m52.003375196s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.588743076 (209h56m52.019823197s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.626251975 (209h56m52.057332106s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.644729239 (209h56m52.075809361s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.648062036 (209h56m52.079142167s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.653418905 (209h56m52.084499036s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.676032545 (209h56m52.107112676s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.714974144 (209h56m52.146054275s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.724317101 (209h56m52.155397232s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760571159 (209h56m52.19165129s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760622617 (209h56m52.191702748s) [seg_pos={0 0}, upload=218362]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:22:57.760801409 (209h56m52.19188154s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KwusATu1ZKtNNVHZZZBE67ZEnVb8puyfQidBi3fEWREqdf1h): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.760954162 (209h56m52.192034293s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DYHaVii53Q4FhtYNBMC64MP1uKHffSTMdfETK8kS94e4ZPfka): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761052078 (209h56m52.192132209s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761199912 (209h56m52.192280043s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761220050 (209h56m52.192300181s) [seg_pos={0 0}, upload=218362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:22:57.761329629 (209h56m52.19240975s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:22:57.761336363 (209h56m52.192416494s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:22:58.128251603 (209h56m52.559331744s) [upload=218362]: Done uploading segments...
Aug 17 11:22:58.128275007 (209h56m52.559355178s) [upload=218362]: Upload finished. err: <nil>
Duration: 5.623658136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X.....................X.........X............X...] duration:
5.543158016s
FAIL (2025-08-17 11:25:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:22:55.189100230 (209h56m49.620180351s) [upload=218362]: Starting upload
Aug 17 11:22:55.189140047 (209h56m49.620220178s) [upload=218362]: Done starting upload
Aug 17 11:22:55.189341442 (209h56m49.620421573s) [upload=218362]: Uploading segments...
Aug 17 11:22:55.189370848 (209h56m49.620450979s) [upload=218362]: Got next segment. Inline: false
Aug 17 11:22:55.189398130 (209h56m49.620478291s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:22:55.189407478 (209h56m49.620487679s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:22:55.657453970 (209h56m50.088534101s) [seg_pos={0 0}, upload=218362]: Begin upload segment...
Aug 17 11:22:55.657514747 (209h56m50.088594878s) [seg_pos={0 0}, upload=218362]: Done begin upload segment.
Aug 17 11:22:55.657548521 (209h56m50.088628652s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.657906125 (209h56m50.088986256s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658039881 (209h56m50.089120012s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658243060 (209h56m50.089323181s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658410380 (209h56m50.089490511s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658526211 (209h56m50.089606342s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658798582 (209h56m50.089878713s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658813171 (209h56m50.089893302s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659089890 (209h56m50.090170021s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659134294 (209h56m50.090214425s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659357042 (209h56m50.090437173s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659446733 (209h56m50.090526864s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659616197 (209h56m50.090696328s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659758128 (209h56m50.090838259s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659887426 (209h56m50.090967557s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660060547 (209h56m50.091140678s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660083521 (209h56m50.091163652s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660415346 (209h56m50.091495467s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:56.858432922 (209h56m51.289513053s) [upload=218362]: Next returned nil segment
Aug 17 11:22:56.858449834 (209h56m51.289529955s) [upload=218362]: Waiting for error group managing segments...
Aug 17 11:22:57.161106823 (209h56m51.592186965s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.563532459 (209h56m51.99461259s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.570030000 (209h56m52.001110131s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.571838611 (209h56m52.002918732s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.572295065 (209h56m52.003375196s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.588743076 (209h56m52.019823197s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.626251975 (209h56m52.057332106s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.644729239 (209h56m52.075809361s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.648062036 (209h56m52.079142167s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.653418905 (209h56m52.084499036s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.676032545 (209h56m52.107112676s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.714974144 (209h56m52.146054275s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.724317101 (209h56m52.155397232s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760571159 (209h56m52.19165129s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760622617 (209h56m52.191702748s) [seg_pos={0 0}, upload=218362]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:22:57.760801409 (209h56m52.19188154s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KwusATu1ZKtNNVHZZZBE67ZEnVb8puyfQidBi3fEWREqdf1h): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.760954162 (209h56m52.192034293s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DYHaVii53Q4FhtYNBMC64MP1uKHffSTMdfETK8kS94e4ZPfka): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761052078 (209h56m52.192132209s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761199912 (209h56m52.192280043s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761220050 (209h56m52.192300181s) [seg_pos={0 0}, upload=218362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:22:57.761329629 (209h56m52.19240975s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:22:57.761336363 (209h56m52.192416494s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:22:58.128251603 (209h56m52.559331744s) [upload=218362]: Done uploading segments...
Aug 17 11:22:58.128275007 (209h56m52.559355178s) [upload=218362]: Upload finished. err: <nil>
Duration: 5.543188815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.91503081s
FAIL (2025-08-17 11:24:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.915045147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X.....................X.........X............X..] duration:
5.522553266s
FAIL (2025-08-17 11:24:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:22:55.189100230 (209h56m49.620180351s) [upload=218362]: Starting upload
Aug 17 11:22:55.189140047 (209h56m49.620220178s) [upload=218362]: Done starting upload
Aug 17 11:22:55.189341442 (209h56m49.620421573s) [upload=218362]: Uploading segments...
Aug 17 11:22:55.189370848 (209h56m49.620450979s) [upload=218362]: Got next segment. Inline: false
Aug 17 11:22:55.189398130 (209h56m49.620478291s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:22:55.189407478 (209h56m49.620487679s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:22:55.657453970 (209h56m50.088534101s) [seg_pos={0 0}, upload=218362]: Begin upload segment...
Aug 17 11:22:55.657514747 (209h56m50.088594878s) [seg_pos={0 0}, upload=218362]: Done begin upload segment.
Aug 17 11:22:55.657548521 (209h56m50.088628652s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.657906125 (209h56m50.088986256s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658039881 (209h56m50.089120012s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658243060 (209h56m50.089323181s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658410380 (209h56m50.089490511s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658526211 (209h56m50.089606342s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658798582 (209h56m50.089878713s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658813171 (209h56m50.089893302s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659089890 (209h56m50.090170021s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659134294 (209h56m50.090214425s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659357042 (209h56m50.090437173s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659446733 (209h56m50.090526864s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659616197 (209h56m50.090696328s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659758128 (209h56m50.090838259s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659887426 (209h56m50.090967557s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660060547 (209h56m50.091140678s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660083521 (209h56m50.091163652s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660415346 (209h56m50.091495467s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:56.858432922 (209h56m51.289513053s) [upload=218362]: Next returned nil segment
Aug 17 11:22:56.858449834 (209h56m51.289529955s) [upload=218362]: Waiting for error group managing segments...
Aug 17 11:22:57.161106823 (209h56m51.592186965s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.563532459 (209h56m51.99461259s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.570030000 (209h56m52.001110131s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.571838611 (209h56m52.002918732s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.572295065 (209h56m52.003375196s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.588743076 (209h56m52.019823197s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.626251975 (209h56m52.057332106s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.644729239 (209h56m52.075809361s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.648062036 (209h56m52.079142167s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.653418905 (209h56m52.084499036s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.676032545 (209h56m52.107112676s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.714974144 (209h56m52.146054275s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.724317101 (209h56m52.155397232s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760571159 (209h56m52.19165129s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760622617 (209h56m52.191702748s) [seg_pos={0 0}, upload=218362]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:22:57.760801409 (209h56m52.19188154s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KwusATu1ZKtNNVHZZZBE67ZEnVb8puyfQidBi3fEWREqdf1h): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.760954162 (209h56m52.192034293s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DYHaVii53Q4FhtYNBMC64MP1uKHffSTMdfETK8kS94e4ZPfka): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761052078 (209h56m52.192132209s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761199912 (209h56m52.192280043s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761220050 (209h56m52.192300181s) [seg_pos={0 0}, upload=218362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:22:57.761329629 (209h56m52.19240975s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:22:57.761336363 (209h56m52.192416494s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:22:58.128251603 (209h56m52.559331744s) [upload=218362]: Done uploading segments...
Aug 17 11:22:58.128275007 (209h56m52.559355178s) [upload=218362]: Upload finished. err: <nil>
Duration: 5.522572323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.052320826s
FAIL (2025-08-17 11:24:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.052346216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X.....................X.........X............X.] duration:
5.763568808s
FAIL (2025-08-17 11:23:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:22:55.189100230 (209h56m49.620180351s) [upload=218362]: Starting upload
Aug 17 11:22:55.189140047 (209h56m49.620220178s) [upload=218362]: Done starting upload
Aug 17 11:22:55.189341442 (209h56m49.620421573s) [upload=218362]: Uploading segments...
Aug 17 11:22:55.189370848 (209h56m49.620450979s) [upload=218362]: Got next segment. Inline: false
Aug 17 11:22:55.189398130 (209h56m49.620478291s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:22:55.189407478 (209h56m49.620487679s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:22:55.657453970 (209h56m50.088534101s) [seg_pos={0 0}, upload=218362]: Begin upload segment...
Aug 17 11:22:55.657514747 (209h56m50.088594878s) [seg_pos={0 0}, upload=218362]: Done begin upload segment.
Aug 17 11:22:55.657548521 (209h56m50.088628652s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.657906125 (209h56m50.088986256s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658039881 (209h56m50.089120012s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658243060 (209h56m50.089323181s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658410380 (209h56m50.089490511s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658526211 (209h56m50.089606342s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658798582 (209h56m50.089878713s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658813171 (209h56m50.089893302s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659089890 (209h56m50.090170021s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659134294 (209h56m50.090214425s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659357042 (209h56m50.090437173s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659446733 (209h56m50.090526864s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659616197 (209h56m50.090696328s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659758128 (209h56m50.090838259s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659887426 (209h56m50.090967557s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660060547 (209h56m50.091140678s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660083521 (209h56m50.091163652s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660415346 (209h56m50.091495467s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:56.858432922 (209h56m51.289513053s) [upload=218362]: Next returned nil segment
Aug 17 11:22:56.858449834 (209h56m51.289529955s) [upload=218362]: Waiting for error group managing segments...
Aug 17 11:22:57.161106823 (209h56m51.592186965s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.563532459 (209h56m51.99461259s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.570030000 (209h56m52.001110131s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.571838611 (209h56m52.002918732s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.572295065 (209h56m52.003375196s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.588743076 (209h56m52.019823197s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.626251975 (209h56m52.057332106s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.644729239 (209h56m52.075809361s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.648062036 (209h56m52.079142167s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.653418905 (209h56m52.084499036s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.676032545 (209h56m52.107112676s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.714974144 (209h56m52.146054275s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.724317101 (209h56m52.155397232s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760571159 (209h56m52.19165129s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760622617 (209h56m52.191702748s) [seg_pos={0 0}, upload=218362]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:22:57.760801409 (209h56m52.19188154s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KwusATu1ZKtNNVHZZZBE67ZEnVb8puyfQidBi3fEWREqdf1h): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.760954162 (209h56m52.192034293s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DYHaVii53Q4FhtYNBMC64MP1uKHffSTMdfETK8kS94e4ZPfka): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761052078 (209h56m52.192132209s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761199912 (209h56m52.192280043s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761220050 (209h56m52.192300181s) [seg_pos={0 0}, upload=218362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:22:57.761329629 (209h56m52.19240975s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:22:57.761336363 (209h56m52.192416494s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:22:58.128251603 (209h56m52.559331744s) [upload=218362]: Done uploading segments...
Aug 17 11:22:58.128275007 (209h56m52.559355178s) [upload=218362]: Upload finished. err: <nil>
Duration: 5.763598573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.886571284s
FAIL (2025-08-17 11:23:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.886603436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X.....................X.........X............X] duration:
4.032669752s
FAIL (2025-08-17 11:22:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:22:55.189100230 (209h56m49.620180351s) [upload=218362]: Starting upload
Aug 17 11:22:55.189140047 (209h56m49.620220178s) [upload=218362]: Done starting upload
Aug 17 11:22:55.189341442 (209h56m49.620421573s) [upload=218362]: Uploading segments...
Aug 17 11:22:55.189370848 (209h56m49.620450979s) [upload=218362]: Got next segment. Inline: false
Aug 17 11:22:55.189398130 (209h56m49.620478291s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:22:55.189407478 (209h56m49.620487679s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:22:55.657453970 (209h56m50.088534101s) [seg_pos={0 0}, upload=218362]: Begin upload segment...
Aug 17 11:22:55.657514747 (209h56m50.088594878s) [seg_pos={0 0}, upload=218362]: Done begin upload segment.
Aug 17 11:22:55.657548521 (209h56m50.088628652s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.657906125 (209h56m50.088986256s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658039881 (209h56m50.089120012s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658243060 (209h56m50.089323181s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658410380 (209h56m50.089490511s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658526211 (209h56m50.089606342s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658798582 (209h56m50.089878713s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.658813171 (209h56m50.089893302s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659089890 (209h56m50.090170021s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659134294 (209h56m50.090214425s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659357042 (209h56m50.090437173s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659446733 (209h56m50.090526864s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659616197 (209h56m50.090696328s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659758128 (209h56m50.090838259s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.659887426 (209h56m50.090967557s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660060547 (209h56m50.091140678s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660083521 (209h56m50.091163652s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:55.660415346 (209h56m50.091495467s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Uploading piece...
Aug 17 11:22:56.858432922 (209h56m51.289513053s) [upload=218362]: Next returned nil segment
Aug 17 11:22:56.858449834 (209h56m51.289529955s) [upload=218362]: Waiting for error group managing segments...
Aug 17 11:22:57.161106823 (209h56m51.592186965s) [noise=true , address=66.23.193.175:4556 , piece_id=WVO2Z3QYUWURJKNKEHHFKQSC26ACHBFEKVX5E3RJHXWGNPR3RUPQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.563532459 (209h56m51.99461259s) [noise=true , address=104.36.82.9:4025 , piece_id=PD64HBXYS36UJQLDHEQOH64ZYW56MPKONHHZIXQWBT27KTUSV3LA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.570030000 (209h56m52.001110131s) [noise=true , address=104.36.82.58:4290 , piece_id=KZQO6UIYO6QTQR5P7OLKTZELHSBP7UB6C6HT4KA45BO4DKP3XZHA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.571838611 (209h56m52.002918732s) [noise=true , address=104.36.82.35:4599 , piece_id=WVWVPFNHMYEUM6UY3QP7ZLDYBHBYMEJZIZOKZ6YPHNIEPRV4IUFA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.572295065 (209h56m52.003375196s) [noise=true , address=79.127.219.47:4055 , piece_id=ZPJCVDLISJ72BPKQ7JGI26RRR6FQA3VBCNH2MFHHRFHD7NQLP4LQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.588743076 (209h56m52.019823197s) [noise=true , address=77.90.31.18:4835 , piece_id=STUPIFEENJHZDUUPQKOH4JOYN3ELXSQ6QKH2OKUO6KHMSTR4X3AQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.626251975 (209h56m52.057332106s) [noise=true , address=104.36.82.5:4847 , piece_id=Z3NSKNHL7UNBPSX2YTTZUNAUAEIOY77HN7PW44OEDCYEBLAV45ZA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.644729239 (209h56m52.075809361s) [noise=true , address=104.36.82.23:4446 , piece_id=IWT425IG6MG3YIN2IUT6IIQG6VNHZ3RCWGTWDTFJGOAHATBQ7RDA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.648062036 (209h56m52.079142167s) [noise=true , address=104.36.82.44:4870 , piece_id=RVZDZK5MI3W5PBZKC6VD4J3YLGQHLZZLQQOVODI3HCG76S2WFSVA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.653418905 (209h56m52.084499036s) [noise=true , address=77.90.31.16:4752 , piece_id=URBHWM546PD4NK2AHF5SXJNIX4O4PBGYRXIXI2NEB25BSSQEOCCQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.676032545 (209h56m52.107112676s) [noise=true , address=79.127.219.48:4106 , piece_id=NXKLLE7MWPMI4DXFFBEHYHJKISAX6O242E53UC3I4D3IECUDOIJQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.714974144 (209h56m52.146054275s) [noise=true , address=45.91.116.9:4288 , piece_id=H65QQGAIXYMP7TEVHHANYCYSUVPXXEB42QXLDCSMPEZO4MVWZNWA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.724317101 (209h56m52.155397232s) [noise=true , address=104.36.82.60:4357 , piece_id=2G562RJAWCBMNFDNEPWUQSBKWP722S4L2IDIMUHHYOECDSY5II5A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760571159 (209h56m52.19165129s) [noise=true , address=77.90.31.13:4634 , piece_id=OT2YPDUTZ75LBDS7DROYAEBZZYJMWHEOPCDIWW53X3KGXJYRXZ4Q, seg_pos={0 0}, upload=218362]: Done uploading piece. err: <nil>
Aug 17 11:22:57.760622617 (209h56m52.191702748s) [seg_pos={0 0}, upload=218362]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:22:57.760801409 (209h56m52.19188154s) [noise=true , address=45.91.116.10:4110 , piece_id=ZBZB5MNYI4N3OAFDKNVL4EDY3YVOYQFOJ7JKAMO3P7V6YZCOIYRA, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123KwusATu1ZKtNNVHZZZBE67ZEnVb8puyfQidBi3fEWREqdf1h): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.760954162 (209h56m52.192034293s) [noise=true , address=77.90.31.10:4539 , piece_id=4GZ4YDOHIY3NPNPL6CE7A3R7WG3D3QHHLOCNPS5TJTEOP4RWCH4A, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DYHaVii53Q4FhtYNBMC64MP1uKHffSTMdfETK8kS94e4ZPfka): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761052078 (209h56m52.192132209s) [noise=true , address=104.36.82.11:4138 , piece_id=MDVPGGPVWTDZLZMGUYOFWMH46BGFMVOKZL3H54DEWZVX6Y5ITQKQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H28XSTvFGa3XhavfhythHWs95cqjazu2RuqpsjNCmdSFvRLoh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761199912 (209h56m52.192280043s) [noise=true , address=104.36.82.4:4833 , piece_id=3TVGQYPSJBXUPZZOGWGVEMYWBWUKL4X5IXAWATC75J6WWVHPRKUQ, seg_pos={0 0}, upload=218362]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 17 11:22:57.761220050 (209h56m52.192300181s) [seg_pos={0 0}, upload=218362]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:22:57.761329629 (209h56m52.19240975s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:22:57.761336363 (209h56m52.192416494s) [upload=218362]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:22:58.128251603 (209h56m52.559331744s) [upload=218362]: Done uploading segments...
Aug 17 11:22:58.128275007 (209h56m52.559355178s) [upload=218362]: Upload finished. err: <nil>
Duration: 4.032693118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.....................X.........X............] duration:
5.820721896s
FAIL (2025-08-17 11:22:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.820748184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.....................X.........X...........] duration:
5.574216052s
FAIL (2025-08-17 11:22:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.574241509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.81322241s
FAIL (2025-08-17 11:22:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813252467s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.....................X.........X..........] duration:
5.631621308s
FAIL (2025-08-17 11:21:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.63165442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.816970323s
FAIL (2025-08-17 11:21:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.81700561s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.....................X.........X.........] duration:
5.613932519s
FAIL (2025-08-17 11:20:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.613956434s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.82737602s
FAIL (2025-08-17 11:20:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827403503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.....................X.........X........] duration:
5.623047965s
FAIL (2025-08-17 11:19:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.623068404s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.834223249s
FAIL (2025-08-17 11:19:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834249901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.....................X.........X.......] duration:
5.589338416s
FAIL (2025-08-17 11:19:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.589358203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.910494076s
FAIL (2025-08-17 11:19:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.910513774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.813639226s
FAIL (2025-08-17 11:18:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813665035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.....................X.........X......] duration:
5.630025329s
FAIL (2025-08-17 11:18:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.630049454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.....................X.........X.....] duration:
5.66503887s
FAIL (2025-08-17 11:18:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.665062716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.788439819s
FAIL (2025-08-17 11:17:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.788503592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.....................X.........X....] duration:
5.679240123s
FAIL (2025-08-17 11:16:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.679265111s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.836742885s
FAIL (2025-08-17 11:16:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836770137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.....................X.........X...] duration:
5.603880672s
FAIL (2025-08-17 11:15:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.603924906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.813701422s
FAIL (2025-08-17 11:15:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813739677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.....................X.........X..] duration:
5.561171481s
FAIL (2025-08-17 11:15:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.561197981s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.890984908s
FAIL (2025-08-17 11:14:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891008644s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.....................X.........X.] duration:
5.74140575s
FAIL (2025-08-17 11:14:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 5.741435236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.....................X.........X] duration:
4.004375916s
FAIL (2025-08-17 11:14:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 11:14:10.888118857 (209h48m5.319198988s) [upload=218211]: Starting upload
Aug 17 11:14:10.888186457 (209h48m5.319266588s) [upload=218211]: Done starting upload
Aug 17 11:14:10.888284303 (209h48m5.319364434s) [upload=218211]: Uploading segments...
Aug 17 11:14:10.888413451 (209h48m5.319493582s) [upload=218211]: Got next segment. Inline: false
Aug 17 11:14:10.888443659 (209h48m5.31952379s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:14:10.888450682 (209h48m5.319530813s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:14:11.359029369 (209h48m5.79010959s) [seg_pos={0 0}, upload=218211]: Begin upload segment...
Aug 17 11:14:11.359123639 (209h48m5.790203861s) [seg_pos={0 0}, upload=218211]: Done begin upload segment.
Aug 17 11:14:11.359165760 (209h48m5.790245891s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359193683 (209h48m5.790273894s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359749066 (209h48m5.790829197s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.359761099 (209h48m5.79084123s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360190230 (209h48m5.791270361s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360554898 (209h48m5.791635029s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.360818683 (209h48m5.791898814s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361080764 (209h48m5.792160895s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361381028 (209h48m5.792461159s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361633551 (209h48m5.792713682s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.361894802 (209h48m5.792974933s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362173184 (209h48m5.793253315s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362305267 (209h48m5.793385398s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362542992 (209h48m5.793623123s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362748225 (209h48m5.793828346s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.362860650 (209h48m5.793940781s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363143642 (209h48m5.794223773s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:11.363257810 (209h48m5.794337941s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Uploading piece...
Aug 17 11:14:12.667888078 (209h48m7.098968209s) [upload=218211]: Next returned nil segment
Aug 17 11:14:12.667908366 (209h48m7.098988487s) [upload=218211]: Waiting for error group managing segments...
Aug 17 11:14:12.936646275 (209h48m7.367726446s) [noise=true , address=66.23.193.175:4563 , piece_id=TRPDT6UU37TTNHU3HQNZAC4XIDEL4RW5YNE5MPTIKVWMPUY5ZKAQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.244906385 (209h48m7.675986516s) [noise=true , address=77.90.31.14:4672 , piece_id=ZVYQHDV6C75BVNR4U3BYOOA4ELR7BZJHYYVAKYAZS6MDP2BTTLUQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.247647279 (209h48m7.67872741s) [noise=true , address=79.127.219.51:4207 , piece_id=X6BAWEEQ5YPZMA7H3LPWXC7YFDHHEJBAHGU23AZY7UHQPDWVPCQA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.250428100 (209h48m7.681508231s) [noise=true , address=77.90.31.11:4557 , piece_id=KZDP6EMJ3M7JHOZ4EAERQIAJFVOBQP74CY3SLSVL3GMRYTGM7EGQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.255395905 (209h48m7.686476036s) [noise=true , address=77.90.31.15:4708 , piece_id=3JDBXETT6KTUFS25WPUVBWTUJ3PNBJGJ6DAWR6Y5G2RDMMNPBOBQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.257024021 (209h48m7.688104142s) [noise=true , address=77.90.31.10:4547 , piece_id=MXO3ZCLH7JIDOTYCL2BJB56SPEHDGXIBWXIPMZRP3PTL3HXDFGTQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.279405796 (209h48m7.710485927s) [noise=true , address=104.36.82.23:4464 , piece_id=XUQ3OSWUGCSQ7XBPKFB7RBN34MSJJHHBJD5EG663FBNQHHI4G2WQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.281882364 (209h48m7.712962495s) [noise=true , address=79.127.219.51:4193 , piece_id=EOQ7FNWOFSTUKSIDA74QQCZFQWUZ7PL2DLKEE62XIPAZHEC5P73Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.325279770 (209h48m7.756359891s) [noise=true , address=104.36.82.19:4403 , piece_id=PDT27JQNVCSHC5QIMNJS447UGWYSUELDDEDVRY2FWBXKV5TTH23A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.327627312 (209h48m7.758707443s) [noise=true , address=45.91.116.10:4108 , piece_id=5F6YP7LGWBPZDNY2MYTDSQPDSROGAOLRXQ2YHEOUDGDMZCSORA3A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.342193502 (209h48m7.773273633s) [noise=true , address=79.127.201.215:4356 , piece_id=TG6NLJSPZJ7DJBROK6B6ZTS22HUBWLQVKOFV2IOKJWRO5SEEP32A, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.350086695 (209h48m7.781166826s) [noise=true , address=45.91.116.4:4943 , piece_id=VIBXM4E4HTLHDCLTXQCP7CERJ2YCSCTRYI3FV3NJANVZP5I2VEIQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.360871430 (209h48m7.791951561s) [noise=true , address=45.91.116.14:4220 , piece_id=QATJCGJDDBBFDYRX6RQ4VCLNED4XOSNFFXKFBLEPROQ7PJ7PPWMQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419847334 (209h48m7.850927465s) [noise=true , address=104.36.82.60:4347 , piece_id=AVVRORJV4MEN4EI4PYWW5RJX52EYM5YK3F2I5DWNAA5IQBKJRJ7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: <nil>
Aug 17 11:14:13.419877421 (209h48m7.850957553s) [seg_pos={0 0}, upload=218211]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:14:13.419996791 (209h48m7.851076922s) [noise=true , address=77.90.31.18:4831 , piece_id=UMCONUQ56EQGZ37HDV5IIBKJ44AER443HMJH7PXE2RCITCFME3VA, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420131417 (209h48m7.851211548s) [noise=true , address=104.36.82.15:4288 , piece_id=74VITIORJHUNATLEPAPML6U364I323GWTFUY6QK4G5EAC6L2ROKQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420157768 (209h48m7.851237889s) [noise=true , address=104.36.82.59:4327 , piece_id=2GUBPSOHZJ3H6LY3CTRIAZTDPH7GTBZQAIPWK3VZL3NCGQ25RU7Q, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420214326 (209h48m7.851294457s) [noise=true , address=77.90.31.21:4901 , piece_id=GNI4RIUHZQFFILEIPVUV74DB45J2ESUR427EGIVEB2PWQTNTCLJQ, seg_pos={0 0}, upload=218211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 17 11:14:13.420251968 (209h48m7.85133212s) [seg_pos={0 0}, upload=218211]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:14:13.420348102 (209h48m7.851428243s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:14:13.420354745 (209h48m7.851434906s) [upload=218211]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:14:13.790058009 (209h48m8.22113818s) [upload=218211]: Done uploading segments...
Aug 17 11:14:13.790082827 (209h48m8.221162998s) [upload=218211]: Upload finished. err: <nil>
Duration: 4.004403428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.832505455s
FAIL (2025-08-17 11:13:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832535863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X.....................X.........] duration:
5.714312671s
FAIL (2025-08-17 11:13:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.714349711s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.....................X........] duration:
5.652604877s
FAIL (2025-08-17 11:12:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.652645886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.870719453s
FAIL (2025-08-17 11:12:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.870746274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.....................X.......] duration:
5.604962901s
FAIL (2025-08-17 11:12:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.604987587s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.824613815s
FAIL (2025-08-17 11:11:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824636258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.....................X......] duration:
5.551367237s
FAIL (2025-08-17 11:11:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.551390933s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X.....................X.....] duration:
5.704659561s
FAIL (2025-08-17 11:11:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.704688668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.093739999s
FAIL (2025-08-17 11:10:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.093770446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.803483777s
FAIL (2025-08-17 11:10:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.803510447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.....................X....] duration:
5.947459439s
FAIL (2025-08-17 11:10:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.947486851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.853315212s
FAIL (2025-08-17 11:09:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853340721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.....................X...] duration:
5.952794169s
FAIL (2025-08-17 11:08:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.95282095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.829443142s
FAIL (2025-08-17 11:08:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829469904s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.....................X..] duration:
5.956168587s
FAIL (2025-08-17 11:08:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.95621734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.289694725s
FAIL (2025-08-17 11:08:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.289719323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.....................X.] duration:
5.747317065s
FAIL (2025-08-17 11:07:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 20f5c17b2a389b9a9a6a81aff30dadb177934992b24c9d05baa0c51475dd21e0 != before 8b13de1f5f56970ea2e7d9a698c60caac3dc1bd6a827bf7b7c912b5dd3e98ecb
======LOGS======
Aug 17 11:06:42.789551667 (209h40m37.220631798s) [upload=218079]: Starting upload
Aug 17 11:06:42.789611722 (209h40m37.220691853s) [upload=218079]: Done starting upload
Aug 17 11:06:42.789745057 (209h40m37.220825178s) [upload=218079]: Uploading segments...
Aug 17 11:06:42.789853595 (209h40m37.220933726s) [upload=218079]: Got next segment. Inline: false
Aug 17 11:06:42.789887530 (209h40m37.220967661s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 11:06:42.789892639 (209h40m37.22097277s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 11:06:43.234438112 (209h40m37.665518253s) [seg_pos={0 0}, upload=218079]: Begin upload segment...
Aug 17 11:06:43.234490963 (209h40m37.665571104s) [seg_pos={0 0}, upload=218079]: Done begin upload segment.
Aug 17 11:06:43.234521061 (209h40m37.665601192s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234545547 (209h40m37.665625678s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.234969138 (209h40m37.666049269s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235054572 (209h40m37.666134703s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235327434 (209h40m37.666407565s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235379594 (209h40m37.666459745s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235676392 (209h40m37.666756523s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.235976846 (209h40m37.667056977s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236324812 (209h40m37.667404943s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236650345 (209h40m37.667730476s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.236786415 (209h40m37.667866546s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237074065 (209h40m37.668154196s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237306060 (209h40m37.668386181s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237546209 (209h40m37.66862633s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.237839450 (209h40m37.668919591s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238167688 (209h40m37.669247819s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238458875 (209h40m37.669539006s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:43.238828913 (209h40m37.669909044s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Uploading piece...
Aug 17 11:06:44.350616309 (209h40m38.78169644s) [upload=218079]: Next returned nil segment
Aug 17 11:06:44.350632009 (209h40m38.78171213s) [upload=218079]: Waiting for error group managing segments...
Aug 17 11:06:44.631489305 (209h40m39.062569436s) [noise=true , address=66.23.193.175:4558 , piece_id=ZSMF2W53DDVE4QDVNNOXYODDRYQPOZVYSBQC2KFVYNNDUFL5HOWA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.133456966 (209h40m39.564537097s) [noise=true , address=77.90.31.12:4618 , piece_id=FLSVYKNDH4KYF24XTYQKTFZ7UNKA6IAAGHQ52EROLIJR37NXYQ6A, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.140679206 (209h40m39.571759337s) [noise=true , address=104.36.82.3:4779 , piece_id=DLJ36XZKRXP65J5KOLLRMMSYKCTPS7Z4PHFKH6JIFCI5TAQGMAXA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.149959422 (209h40m39.581039553s) [noise=true , address=104.36.82.4:4833 , piece_id=RUL2WQT6DVEABR5WRE32LJTYTFUHTRSRJI4BU2VR2GDCYULIGBIQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.167132351 (209h40m39.598212472s) [noise=true , address=104.36.82.2:4734 , piece_id=HMTBZPOOTIMKZSDB4BSJD6ZJK26AGMSLBDVSPPK4GDJ64VO7ZPAQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.172737595 (209h40m39.603817726s) [noise=true , address=77.90.31.11:4567 , piece_id=HQYRFBFL4GOPSOAKSYHVRUFT65CYRKFSIRKWBZU37EP52KZVCSVA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.179154353 (209h40m39.610234484s) [noise=true , address=77.90.31.16:4757 , piece_id=AZRDFUHJKSFOKDAO7EGPHN6R6RSK2QPZUKCAFFJT2DEWG3XQXWCA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.208512857 (209h40m39.639592988s) [noise=true , address=79.127.201.215:4346 , piece_id=XKBGL5QHPHTDT2IIGRAZ5DWAXIXIH5BHD3GZJOCFERYACMRWJYTQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.209183810 (209h40m39.640263931s) [noise=true , address=104.36.82.40:4958 , piece_id=4K2NCQWGSWBQMSYNVV2FBD5F3B5CEOHDGBU5HF6MW4B4DTSDEVWQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.211553555 (209h40m39.642633686s) [noise=true , address=45.91.116.8:4063 , piece_id=LUKZUXPOF5D6ESL25HDDGBRIYPCZA3OO5CQAKY4L6GLRJAHBF2RQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.247839483 (209h40m39.678919605s) [noise=true , address=104.36.82.38:4697 , piece_id=6ZKPQN4W7NGC3TPOTFBZXE6JVBKIP7VPPTVTR3E2F2AMYAQLE55Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.255155823 (209h40m39.686235944s) [noise=true , address=104.36.82.19:4403 , piece_id=EQO736XRFQ5YXHJFTGH6N6QUTIYDHCO5ATWX3YW5ZFRMHEIRBWQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.265339658 (209h40m39.696419789s) [noise=true , address=104.36.82.59:4314 , piece_id=7373TBMKHR3BRBJXZZYEUBKJ4BZ3Z4AAENCYGRLZ2TENCIJSCN7Q, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267134211 (209h40m39.698214342s) [noise=true , address=77.90.31.14:4676 , piece_id=XE4ACW7W4BJHHJ3RS2Z3JQA4GERKGICT77WKV6BT3WTX2Q6M6BEA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: <nil>
Aug 17 11:06:45.267154821 (209h40m39.698234942s) [seg_pos={0 0}, upload=218079]: Segment reached optimal threshold of 14 pieces.
Aug 17 11:06:45.267356376 (209h40m39.698436507s) [noise=true , address=104.36.82.23:4474 , piece_id=BAR2WCUSBFCEJPILZFLCV27XOLOBP6DKXUJ4Y3AB44VZSBJV2APQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267436229 (209h40m39.69851635s) [noise=true , address=77.90.31.13:4648 , piece_id=SPMPXJVRML67RI7LJR5SGGXZ7SQAT733DJNMUJN2MXHYYWI5WGOA, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niTsTaHjA6LoMMrkEsSnLcRDhZtVAjxsbXUXVeXzhUp3FPbWh): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267490623 (209h40m39.698570754s) [noise=true , address=104.36.82.60:4345 , piece_id=NGCYXBQWK2VQI5ZRO6V5TAPKVPLXR7EUPGL5B6U3UKZOG4DPVHDQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KSTyRJ62wcMHx8K7uwqp5e8L8yhxH7V3YtBHnYu6QJ3K3bXpQ): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267530660 (209h40m39.698610792s) [noise=true , address=77.90.31.10:4531 , piece_id=BHMENG4WDF66EW75ANJ5VWONWEHQGNM7GORRACFAYXTFM4I23FQQ, seg_pos={0 0}, upload=218079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AvSrhj1nHWLBJrw1SKacnjPTi9g4AzjqKvVFoxtzAdJFYAfQt): protocol: expected piece hash; context canceled; EOF
Aug 17 11:06:45.267549546 (209h40m39.698629687s) [seg_pos={0 0}, upload=218079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 11:06:45.267651070 (209h40m39.698731202s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 11:06:45.267658484 (209h40m39.698738615s) [upload=218079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 11:06:45.562813217 (209h40m39.993893348s) [upload=218079]: Done uploading segments...
Aug 17 11:06:45.562831963 (209h40m39.993912094s) [upload=218079]: Upload finished. err: <nil>
Duration: 5.747345499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|