Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.................X..X...X.................] duration: 5.740534304s FAIL (2025-08-07 10:58:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.740557217s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X..X.......X...............................] duration: 1.897514882s FAIL (2025-08-07 10:57:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.897543698s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.................X..X...X................] duration: 5.637552714s FAIL (2025-08-07 10:57:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.637578653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X..X.......X..............................] duration: 1.897096969s FAIL (2025-08-07 10:56:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.897120023s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X.................X..X...X...............] duration: 5.598402506s FAIL (2025-08-07 10:56:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.598432073s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X..X.......X.............................] duration: 1.817786768s FAIL (2025-08-07 10:55:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.817805335s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X.................X..X...X..............] duration: 5.887771774s FAIL (2025-08-07 10:55:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.887794987s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X..X.......X............................] duration: 1.973670476s FAIL (2025-08-07 10:55:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.973700163s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.................X..X...X.............] duration: 5.753684746s FAIL (2025-08-07 10:55:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.753701067s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..X.......X...........................] duration: 1.853601934s FAIL (2025-08-07 10:55:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.853627813s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X..X.......X..........................] duration: 1.896855239s FAIL (2025-08-07 10:54:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.896878856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X.................X..X...X............] duration: 5.792007413s FAIL (2025-08-07 10:54:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.792039524s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.................X..X...X...........] duration: 5.614640999s FAIL (2025-08-07 10:53:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.614668731s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..X.......X.........................] duration: 2.366227244s FAIL (2025-08-07 10:53:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.366247472s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X..X.......X........................] duration: 1.801474339s FAIL (2025-08-07 10:53:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.801502083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X.................X..X...X..........] duration: 5.62570938s FAIL (2025-08-07 10:53:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.62573521s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..X.......X.......................] duration: 1.839906479s FAIL (2025-08-07 10:52:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.839928962s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.................X..X...X.........] duration: 5.785951856s FAIL (2025-08-07 10:52:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.785974328s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.................X..X...X........] duration: 5.919089772s FAIL (2025-08-07 10:51:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.91911522s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..X.......X......................] duration: 1.869101447s FAIL (2025-08-07 10:51:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.869129009s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.................X..X...X.......] duration: 5.53371639s FAIL (2025-08-07 10:51:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.533734706s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..X.......X.....................] duration: 1.915751153s FAIL (2025-08-07 10:51:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.915788814s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X.................X..X...X......] duration: 5.963475066s FAIL (2025-08-07 10:50:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.963515904s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X..X.......X....................] duration: 1.847027604s FAIL (2025-08-07 10:49:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.847052433s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.................X..X...X.....] duration: 5.515412889s FAIL (2025-08-07 10:49:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.515433028s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..X.......X...................] duration: 2.053763967s FAIL (2025-08-07 10:48:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.053790288s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.................X..X...X....] duration: 5.676110768s FAIL (2025-08-07 10:48:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.676137449s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..X.......X..................] duration: 1.899163864s FAIL (2025-08-07 10:48:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.899189343s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................X.................X..X...X...] duration: 5.741852969s FAIL (2025-08-07 10:48:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.741876633s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X.................X..X...X..] duration: 5.62952733s FAIL (2025-08-07 10:47:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.629555013s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.................X..X...X.] duration: 5.68054825s FAIL (2025-08-07 10:47:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.680573047s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..X.......X.................] duration: 2.341628683s FAIL (2025-08-07 10:47:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.341667285s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.................................X.................X..X...X] duration: 859.70559ms FAIL (2025-08-07 10:46:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 859.732882ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X..X.......X................] duration: 1.900972716s FAIL (2025-08-07 10:46:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.900998003s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.................................X.................X..X...] duration: 5.760294764s FAIL (2025-08-07 10:46:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== mit Aug 7 10:43:45.884839108 (1h3m45.474184095s) [upload=1102]: Done uploading segments... Aug 7 10:43:45.884857353 (1h3m45.47420233s) [upload=1102]: Upload finished. err: <nil> Aug 7 10:44:34.917937131 (1h4m34.507282118s) [upload=1120]: Starting upload Aug 7 10:44:34.917983480 (1h4m34.507328467s) [upload=1120]: Done starting upload Aug 7 10:44:34.918066779 (1h4m34.507411796s) [upload=1120]: Uploading segments... Aug 7 10:44:34.918285357 (1h4m34.507630414s) [upload=1120]: Got next segment. Inline: false Aug 7 10:44:34.918336866 (1h4m34.507681853s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:44:34.918341384 (1h4m34.507686361s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:44:35.388820518 (1h4m34.978165505s) [seg_pos={0 0}, upload=1120]: Begin upload segment... Aug 7 10:44:35.388871857 (1h4m34.978216844s) [seg_pos={0 0}, upload=1120]: Done begin upload segment. Aug 7 10:44:35.388893578 (1h4m34.978238565s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.388932593 (1h4m34.97827757s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389263756 (1h4m34.978608743s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389560494 (1h4m34.978905481s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390220878 (1h4m34.979565865s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390500182 (1h4m34.979845169s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390564194 (1h4m34.979909181s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390759137 (1h4m34.980104124s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390788994 (1h4m34.980133981s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391020337 (1h4m34.980365314s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391116731 (1h4m34.980461718s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391262611 (1h4m34.980607598s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391507148 (1h4m34.980852125s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391750323 (1h4m34.981095311s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392083240 (1h4m34.981428227s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392374197 (1h4m34.981719185s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392621430 (1h4m34.981966408s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392924470 (1h4m34.982269457s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:36.557242667 (1h4m36.146587654s) [upload=1120]: Next returned nil segment Aug 7 10:44:36.557262124 (1h4m36.146607111s) [upload=1120]: Waiting for error group managing segments... Aug 7 10:44:36.857721865 (1h4m36.447066853s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.877585881 (1h4m36.466930868s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.958107791 (1h4m36.547452778s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.299556545 (1h4m36.888901522s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.311925169 (1h4m36.901270156s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.316127690 (1h4m36.905472677s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.319110887 (1h4m36.908455874s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.360586021 (1h4m36.949930998s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.387784368 (1h4m36.977129355s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.392488829 (1h4m36.981833816s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.397985506 (1h4m36.987330483s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.407768243 (1h4m36.99711323s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.409982580 (1h4m36.999327567s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419347597 (1h4m37.008692584s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419364981 (1h4m37.008709968s) [seg_pos={0 0}, upload=1120]: Segment reached optimal threshold of 14 pieces. Aug 7 10:44:37.419511281 (1h4m37.008856268s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QCXnCqsnF4z6YenY9FPGC6BSN5EXuQ6VVA9F42KqEx2Bgxf8b): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419564993 (1h4m37.00890997s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nctdBBFSDaAV2c5PUbZW64K3v9CH3a49NSfTh6dta4DVxtqXA): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419616151 (1h4m37.008961139s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419644766 (1h4m37.008989753s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RBz5y29KovULcdWuaccKtWRJb2mVbifY6zqZAd3qzvBEffaVS): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419659795 (1h4m37.009004772s) [seg_pos={0 0}, upload=1120]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:44:37.419716494 (1h4m37.009061481s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:44:37.419720271 (1h4m37.009065258s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:44:37.741562773 (1h4m37.33090776s) [upload=1120]: Done uploading segments... Aug 7 10:44:37.741580617 (1h4m37.330925604s) [upload=1120]: Upload finished. err: <nil> Duration: 5.760316467s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.................................X.................X..X..] duration: 5.858639076s FAIL (2025-08-07 10:45:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== mit Aug 7 10:43:45.884839108 (1h3m45.474184095s) [upload=1102]: Done uploading segments... Aug 7 10:43:45.884857353 (1h3m45.47420233s) [upload=1102]: Upload finished. err: <nil> Aug 7 10:44:34.917937131 (1h4m34.507282118s) [upload=1120]: Starting upload Aug 7 10:44:34.917983480 (1h4m34.507328467s) [upload=1120]: Done starting upload Aug 7 10:44:34.918066779 (1h4m34.507411796s) [upload=1120]: Uploading segments... Aug 7 10:44:34.918285357 (1h4m34.507630414s) [upload=1120]: Got next segment. Inline: false Aug 7 10:44:34.918336866 (1h4m34.507681853s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:44:34.918341384 (1h4m34.507686361s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:44:35.388820518 (1h4m34.978165505s) [seg_pos={0 0}, upload=1120]: Begin upload segment... Aug 7 10:44:35.388871857 (1h4m34.978216844s) [seg_pos={0 0}, upload=1120]: Done begin upload segment. Aug 7 10:44:35.388893578 (1h4m34.978238565s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.388932593 (1h4m34.97827757s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389263756 (1h4m34.978608743s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389560494 (1h4m34.978905481s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390220878 (1h4m34.979565865s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390500182 (1h4m34.979845169s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390564194 (1h4m34.979909181s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390759137 (1h4m34.980104124s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390788994 (1h4m34.980133981s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391020337 (1h4m34.980365314s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391116731 (1h4m34.980461718s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391262611 (1h4m34.980607598s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391507148 (1h4m34.980852125s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391750323 (1h4m34.981095311s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392083240 (1h4m34.981428227s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392374197 (1h4m34.981719185s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392621430 (1h4m34.981966408s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392924470 (1h4m34.982269457s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:36.557242667 (1h4m36.146587654s) [upload=1120]: Next returned nil segment Aug 7 10:44:36.557262124 (1h4m36.146607111s) [upload=1120]: Waiting for error group managing segments... Aug 7 10:44:36.857721865 (1h4m36.447066853s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.877585881 (1h4m36.466930868s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.958107791 (1h4m36.547452778s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.299556545 (1h4m36.888901522s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.311925169 (1h4m36.901270156s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.316127690 (1h4m36.905472677s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.319110887 (1h4m36.908455874s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.360586021 (1h4m36.949930998s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.387784368 (1h4m36.977129355s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.392488829 (1h4m36.981833816s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.397985506 (1h4m36.987330483s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.407768243 (1h4m36.99711323s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.409982580 (1h4m36.999327567s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419347597 (1h4m37.008692584s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419364981 (1h4m37.008709968s) [seg_pos={0 0}, upload=1120]: Segment reached optimal threshold of 14 pieces. Aug 7 10:44:37.419511281 (1h4m37.008856268s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QCXnCqsnF4z6YenY9FPGC6BSN5EXuQ6VVA9F42KqEx2Bgxf8b): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419564993 (1h4m37.00890997s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nctdBBFSDaAV2c5PUbZW64K3v9CH3a49NSfTh6dta4DVxtqXA): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419616151 (1h4m37.008961139s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419644766 (1h4m37.008989753s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RBz5y29KovULcdWuaccKtWRJb2mVbifY6zqZAd3qzvBEffaVS): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419659795 (1h4m37.009004772s) [seg_pos={0 0}, upload=1120]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:44:37.419716494 (1h4m37.009061481s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:44:37.419720271 (1h4m37.009065258s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:44:37.741562773 (1h4m37.33090776s) [upload=1120]: Done uploading segments... Aug 7 10:44:37.741580617 (1h4m37.330925604s) [upload=1120]: Upload finished. err: <nil> Duration: 5.858664646s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..X.......X...............] duration: 2.130897856s FAIL (2025-08-07 10:45:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.130922894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.................................X.................X..X.] duration: 5.700167499s FAIL (2025-08-07 10:45:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== mit Aug 7 10:43:45.884839108 (1h3m45.474184095s) [upload=1102]: Done uploading segments... Aug 7 10:43:45.884857353 (1h3m45.47420233s) [upload=1102]: Upload finished. err: <nil> Aug 7 10:44:34.917937131 (1h4m34.507282118s) [upload=1120]: Starting upload Aug 7 10:44:34.917983480 (1h4m34.507328467s) [upload=1120]: Done starting upload Aug 7 10:44:34.918066779 (1h4m34.507411796s) [upload=1120]: Uploading segments... Aug 7 10:44:34.918285357 (1h4m34.507630414s) [upload=1120]: Got next segment. Inline: false Aug 7 10:44:34.918336866 (1h4m34.507681853s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:44:34.918341384 (1h4m34.507686361s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:44:35.388820518 (1h4m34.978165505s) [seg_pos={0 0}, upload=1120]: Begin upload segment... Aug 7 10:44:35.388871857 (1h4m34.978216844s) [seg_pos={0 0}, upload=1120]: Done begin upload segment. Aug 7 10:44:35.388893578 (1h4m34.978238565s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.388932593 (1h4m34.97827757s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389263756 (1h4m34.978608743s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389560494 (1h4m34.978905481s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390220878 (1h4m34.979565865s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390500182 (1h4m34.979845169s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390564194 (1h4m34.979909181s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390759137 (1h4m34.980104124s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390788994 (1h4m34.980133981s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391020337 (1h4m34.980365314s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391116731 (1h4m34.980461718s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391262611 (1h4m34.980607598s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391507148 (1h4m34.980852125s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391750323 (1h4m34.981095311s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392083240 (1h4m34.981428227s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392374197 (1h4m34.981719185s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392621430 (1h4m34.981966408s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392924470 (1h4m34.982269457s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:36.557242667 (1h4m36.146587654s) [upload=1120]: Next returned nil segment Aug 7 10:44:36.557262124 (1h4m36.146607111s) [upload=1120]: Waiting for error group managing segments... Aug 7 10:44:36.857721865 (1h4m36.447066853s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.877585881 (1h4m36.466930868s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.958107791 (1h4m36.547452778s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.299556545 (1h4m36.888901522s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.311925169 (1h4m36.901270156s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.316127690 (1h4m36.905472677s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.319110887 (1h4m36.908455874s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.360586021 (1h4m36.949930998s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.387784368 (1h4m36.977129355s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.392488829 (1h4m36.981833816s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.397985506 (1h4m36.987330483s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.407768243 (1h4m36.99711323s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.409982580 (1h4m36.999327567s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419347597 (1h4m37.008692584s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419364981 (1h4m37.008709968s) [seg_pos={0 0}, upload=1120]: Segment reached optimal threshold of 14 pieces. Aug 7 10:44:37.419511281 (1h4m37.008856268s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QCXnCqsnF4z6YenY9FPGC6BSN5EXuQ6VVA9F42KqEx2Bgxf8b): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419564993 (1h4m37.00890997s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nctdBBFSDaAV2c5PUbZW64K3v9CH3a49NSfTh6dta4DVxtqXA): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419616151 (1h4m37.008961139s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419644766 (1h4m37.008989753s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RBz5y29KovULcdWuaccKtWRJb2mVbifY6zqZAd3qzvBEffaVS): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419659795 (1h4m37.009004772s) [seg_pos={0 0}, upload=1120]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:44:37.419716494 (1h4m37.009061481s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:44:37.419720271 (1h4m37.009065258s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:44:37.741562773 (1h4m37.33090776s) [upload=1120]: Done uploading segments... Aug 7 10:44:37.741580617 (1h4m37.330925604s) [upload=1120]: Upload finished. err: <nil> Duration: 5.700193348s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..X.......X..............] duration: 1.962391529s FAIL (2025-08-07 10:44:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.962419352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.................................X.................X..X] duration: 4.005098691s FAIL (2025-08-07 10:44:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== mit Aug 7 10:43:45.884839108 (1h3m45.474184095s) [upload=1102]: Done uploading segments... Aug 7 10:43:45.884857353 (1h3m45.47420233s) [upload=1102]: Upload finished. err: <nil> Aug 7 10:44:34.917937131 (1h4m34.507282118s) [upload=1120]: Starting upload Aug 7 10:44:34.917983480 (1h4m34.507328467s) [upload=1120]: Done starting upload Aug 7 10:44:34.918066779 (1h4m34.507411796s) [upload=1120]: Uploading segments... Aug 7 10:44:34.918285357 (1h4m34.507630414s) [upload=1120]: Got next segment. Inline: false Aug 7 10:44:34.918336866 (1h4m34.507681853s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:44:34.918341384 (1h4m34.507686361s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:44:35.388820518 (1h4m34.978165505s) [seg_pos={0 0}, upload=1120]: Begin upload segment... Aug 7 10:44:35.388871857 (1h4m34.978216844s) [seg_pos={0 0}, upload=1120]: Done begin upload segment. Aug 7 10:44:35.388893578 (1h4m34.978238565s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.388932593 (1h4m34.97827757s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389263756 (1h4m34.978608743s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.389560494 (1h4m34.978905481s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390220878 (1h4m34.979565865s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390500182 (1h4m34.979845169s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390564194 (1h4m34.979909181s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390759137 (1h4m34.980104124s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.390788994 (1h4m34.980133981s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391020337 (1h4m34.980365314s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391116731 (1h4m34.980461718s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391262611 (1h4m34.980607598s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391507148 (1h4m34.980852125s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.391750323 (1h4m34.981095311s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392083240 (1h4m34.981428227s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392374197 (1h4m34.981719185s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392621430 (1h4m34.981966408s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:35.392924470 (1h4m34.982269457s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Uploading piece... Aug 7 10:44:36.557242667 (1h4m36.146587654s) [upload=1120]: Next returned nil segment Aug 7 10:44:36.557262124 (1h4m36.146607111s) [upload=1120]: Waiting for error group managing segments... Aug 7 10:44:36.857721865 (1h4m36.447066853s) [noise=true , address=64.49.13.169:4715 , piece_id=Z7NUDEJ3WQDIWJMXMK4PYEVNEW3NS33GBBPUIIQYDWDKVEXYJBWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.877585881 (1h4m36.466930868s) [noise=true , address=64.49.13.27:4957 , piece_id=DKJ43MMT4HHS2XLYINBULDC4RCAB3IJ43EI2RAID4DE6JVMYSG3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:36.958107791 (1h4m36.547452778s) [noise=true , address=64.49.13.26:4952 , piece_id=SJXM6X7OICFWIFDHK4P5DU77BYTTXL2TGZUPCHT3TE57SPEBTH7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.299556545 (1h4m36.888901522s) [noise=true , address=104.36.82.37:4669 , piece_id=PKWMBNNAHYVKK7LDR2DHZSMF3QR3KJNSFUZ7ESFUBFBKP4IMHRXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.311925169 (1h4m36.901270156s) [noise=true , address=104.36.82.23:4469 , piece_id=K7REANHB5ARHF7UD6Z2BYGXTPJNZX5QIE2YLHHLA66L5HPFZD6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.316127690 (1h4m36.905472677s) [noise=true , address=104.36.82.16:4319 , piece_id=X7VUTGUS5OHU4KFMKQSW45DYQHRJLGTBJY5MWMWKCUX5HCT3TBFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.319110887 (1h4m36.908455874s) [noise=true , address=104.36.82.61:4381 , piece_id=RY6QOGEEASBN6VEPSWNFP3AJWQAKF372HCMD3DLPSOYGZIULQIXQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.360586021 (1h4m36.949930998s) [noise=true , address=104.36.82.16:4297 , piece_id=5HNK6QK2EJ2ROO6TACDYSEJ4GQX2HOY6GGHGXI2VZCXGMQ4AGPEQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.387784368 (1h4m36.977129355s) [noise=true , address=104.36.82.59:4307 , piece_id=NN3BJKFSP53LYFMVX5PLGRIYJPB4YSMHXGQXZBAGRUO6735RPXZA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.392488829 (1h4m36.981833816s) [noise=true , address=104.36.82.47:4547 , piece_id=K4JHXXPOYM7BX2EY3GV4XFWHCXINTC3IFEHKEUYJFMRALZCBPA5Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.397985506 (1h4m36.987330483s) [noise=true , address=104.36.82.13:4190 , piece_id=UB7Z6JGLAFZ2YA2WARFRCJLMG6PBAC3QCTR5YVSEZELI4OBOOOFA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.407768243 (1h4m36.99711323s) [noise=true , address=104.36.82.60:4355 , piece_id=3NFFBCTR3K67BFV7Y4QQIJYUIRKBKIKTIJ55MORVGOIIRZTR3JTQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.409982580 (1h4m36.999327567s) [noise=true , address=104.36.82.53:4140 , piece_id=MI2HS2PZXDUGO5IZJ3C5AOOSQE3DK73SPOL3P77TQJBVUR3KC6PQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419347597 (1h4m37.008692584s) [noise=true , address=104.36.82.52:4100 , piece_id=6YY6WDSSPCQPWT554ZKDO5ZG2XOB24EGGXB7H6VPTWNFKVEION6A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: <nil> Aug 7 10:44:37.419364981 (1h4m37.008709968s) [seg_pos={0 0}, upload=1120]: Segment reached optimal threshold of 14 pieces. Aug 7 10:44:37.419511281 (1h4m37.008856268s) [noise=true , address=104.36.82.44:4879 , piece_id=CQWVI4HP7VO2Z7GQNPIPBJDIHD7GXGYBNT3F7D2JS6DMZ7DNUNWQ, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QCXnCqsnF4z6YenY9FPGC6BSN5EXuQ6VVA9F42KqEx2Bgxf8b): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419564993 (1h4m37.00890997s) [noise=true , address=104.36.82.58:4296 , piece_id=DUBXFJKNOOWP7ZJHWQIUUZVAAR5XRGU5AG33SGJCV2Z5KVHNKW7A, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nctdBBFSDaAV2c5PUbZW64K3v9CH3a49NSfTh6dta4DVxtqXA): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419616151 (1h4m37.008961139s) [noise=true , address=104.36.82.62:4423 , piece_id=ZYFN3IYL6BDVC25ZFR2RO5DVLFDH7QCAEXFGTI4PDGTHI5WQKY3Q, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419644766 (1h4m37.008989753s) [noise=true , address=104.36.82.43:4862 , piece_id=BSRO6EMSGEY7X53YVLIDDBBE4776UHZV4KTBFI4VGLEQZH2WKSRA, seg_pos={0 0}, upload=1120]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RBz5y29KovULcdWuaccKtWRJb2mVbifY6zqZAd3qzvBEffaVS): protocol: expected piece hash; context canceled; EOF Aug 7 10:44:37.419659795 (1h4m37.009004772s) [seg_pos={0 0}, upload=1120]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:44:37.419716494 (1h4m37.009061481s) [upload=1120]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:44:37.419720271 (1h4m37.009065258s) [upload=1120]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:44:37.741562773 (1h4m37.33090776s) [upload=1120]: Done uploading segments... Aug 7 10:44:37.741580617 (1h4m37.330925604s) [upload=1120]: Upload finished. err: <nil> Duration: 4.005123748s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..X.......X.............] duration: 1.903309356s FAIL (2025-08-07 10:44:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.903341949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.................................X.................X..] duration: 5.670134878s FAIL (2025-08-07 10:43:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== ectCommit Aug 7 10:41:31.423183498 (1h1m31.012528485s) [upload=1063]: Done uploading segments... Aug 7 10:41:31.423202233 (1h1m31.01254721s) [upload=1063]: Upload finished. err: <nil> Aug 7 10:42:17.683319978 (1h2m17.272664955s) [upload=1077]: Starting upload Aug 7 10:42:17.683365496 (1h2m17.272710483s) [upload=1077]: Done starting upload Aug 7 10:42:17.683570507 (1h2m17.272915484s) [upload=1077]: Uploading segments... Aug 7 10:42:17.683603260 (1h2m17.272948237s) [upload=1077]: Got next segment. Inline: false Aug 7 10:42:17.683641113 (1h2m17.2729861s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:42:17.683645541 (1h2m17.272990528s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:42:18.132597838 (1h2m17.721942825s) [seg_pos={0 0}, upload=1077]: Begin upload segment... Aug 7 10:42:18.132645098 (1h2m17.721990086s) [seg_pos={0 0}, upload=1077]: Done begin upload segment. Aug 7 10:42:18.132665938 (1h2m17.722010925s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.132710503 (1h2m17.72205549s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133023011 (1h2m17.722367988s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133239555 (1h2m17.722584542s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133302897 (1h2m17.722647884s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133594945 (1h2m17.722939932s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133606748 (1h2m17.722951776s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133929686 (1h2m17.723274663s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134001193 (1h2m17.72334618s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134180617 (1h2m17.723525604s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134272783 (1h2m17.72361777s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134393323 (1h2m17.72373831s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134530746 (1h2m17.723875733s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134611160 (1h2m17.723956137s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134860547 (1h2m17.724205534s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135084766 (1h2m17.724429753s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135277394 (1h2m17.724622381s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.136035114 (1h2m17.725380091s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:19.247195966 (1h2m18.836540953s) [upload=1077]: Next returned nil segment Aug 7 10:42:19.247213139 (1h2m18.836558136s) [upload=1077]: Waiting for error group managing segments... Aug 7 10:42:19.529988916 (1h2m19.119333903s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.554219786 (1h2m19.143564773s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.617577577 (1h2m19.206922564s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.056832030 (1h2m19.646177017s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.057005792 (1h2m19.64635078s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.063331355 (1h2m19.652676342s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.068968731 (1h2m19.658313718s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069285817 (1h2m19.658630804s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069535785 (1h2m19.658880772s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.072393092 (1h2m19.661738099s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.116962757 (1h2m19.706307734s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.138498000 (1h2m19.727842987s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.154271158 (1h2m19.743616145s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163211273 (1h2m19.75255625s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163247472 (1h2m19.752592459s) [seg_pos={0 0}, upload=1077]: Segment reached optimal threshold of 14 pieces. Aug 7 10:42:20.163330972 (1h2m19.752675959s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164833336 (1h2m19.754178323s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qTLdkqYYRGs1fpm8ZP17cGxPUYJCrspBwffuGbd6JbwcsRf65): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164884093 (1h2m19.75422908s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a453d6xSb26epbgqPuco3UPTf9yzoxBeKToCUMNiNHUddAq55): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164980748 (1h2m19.754325725s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164989565 (1h2m19.754334552s) [seg_pos={0 0}, upload=1077]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:42:20.165036384 (1h2m19.754381372s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:42:20.165039711 (1h2m19.754384698s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:42:20.472172990 (1h2m20.061517977s) [upload=1077]: Done uploading segments... Aug 7 10:42:20.472196515 (1h2m20.061541502s) [upload=1077]: Upload finished. err: <nil> Duration: 5.67016198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.................................X.................X.] duration: 5.866266018s FAIL (2025-08-07 10:43:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== ectCommit Aug 7 10:41:31.423183498 (1h1m31.012528485s) [upload=1063]: Done uploading segments... Aug 7 10:41:31.423202233 (1h1m31.01254721s) [upload=1063]: Upload finished. err: <nil> Aug 7 10:42:17.683319978 (1h2m17.272664955s) [upload=1077]: Starting upload Aug 7 10:42:17.683365496 (1h2m17.272710483s) [upload=1077]: Done starting upload Aug 7 10:42:17.683570507 (1h2m17.272915484s) [upload=1077]: Uploading segments... Aug 7 10:42:17.683603260 (1h2m17.272948237s) [upload=1077]: Got next segment. Inline: false Aug 7 10:42:17.683641113 (1h2m17.2729861s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:42:17.683645541 (1h2m17.272990528s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:42:18.132597838 (1h2m17.721942825s) [seg_pos={0 0}, upload=1077]: Begin upload segment... Aug 7 10:42:18.132645098 (1h2m17.721990086s) [seg_pos={0 0}, upload=1077]: Done begin upload segment. Aug 7 10:42:18.132665938 (1h2m17.722010925s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.132710503 (1h2m17.72205549s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133023011 (1h2m17.722367988s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133239555 (1h2m17.722584542s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133302897 (1h2m17.722647884s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133594945 (1h2m17.722939932s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133606748 (1h2m17.722951776s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133929686 (1h2m17.723274663s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134001193 (1h2m17.72334618s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134180617 (1h2m17.723525604s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134272783 (1h2m17.72361777s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134393323 (1h2m17.72373831s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134530746 (1h2m17.723875733s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134611160 (1h2m17.723956137s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134860547 (1h2m17.724205534s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135084766 (1h2m17.724429753s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135277394 (1h2m17.724622381s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.136035114 (1h2m17.725380091s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:19.247195966 (1h2m18.836540953s) [upload=1077]: Next returned nil segment Aug 7 10:42:19.247213139 (1h2m18.836558136s) [upload=1077]: Waiting for error group managing segments... Aug 7 10:42:19.529988916 (1h2m19.119333903s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.554219786 (1h2m19.143564773s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.617577577 (1h2m19.206922564s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.056832030 (1h2m19.646177017s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.057005792 (1h2m19.64635078s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.063331355 (1h2m19.652676342s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.068968731 (1h2m19.658313718s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069285817 (1h2m19.658630804s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069535785 (1h2m19.658880772s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.072393092 (1h2m19.661738099s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.116962757 (1h2m19.706307734s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.138498000 (1h2m19.727842987s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.154271158 (1h2m19.743616145s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163211273 (1h2m19.75255625s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163247472 (1h2m19.752592459s) [seg_pos={0 0}, upload=1077]: Segment reached optimal threshold of 14 pieces. Aug 7 10:42:20.163330972 (1h2m19.752675959s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164833336 (1h2m19.754178323s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qTLdkqYYRGs1fpm8ZP17cGxPUYJCrspBwffuGbd6JbwcsRf65): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164884093 (1h2m19.75422908s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a453d6xSb26epbgqPuco3UPTf9yzoxBeKToCUMNiNHUddAq55): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164980748 (1h2m19.754325725s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164989565 (1h2m19.754334552s) [seg_pos={0 0}, upload=1077]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:42:20.165036384 (1h2m19.754381372s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:42:20.165039711 (1h2m19.754384698s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:42:20.472172990 (1h2m20.061517977s) [upload=1077]: Done uploading segments... Aug 7 10:42:20.472196515 (1h2m20.061541502s) [upload=1077]: Upload finished. err: <nil> Duration: 5.866290897s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X..X.......X............] duration: 1.881198904s FAIL (2025-08-07 10:43:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.881225265s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.................................X.................X] duration: 3.904563939s FAIL (2025-08-07 10:42:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== ectCommit Aug 7 10:41:31.423183498 (1h1m31.012528485s) [upload=1063]: Done uploading segments... Aug 7 10:41:31.423202233 (1h1m31.01254721s) [upload=1063]: Upload finished. err: <nil> Aug 7 10:42:17.683319978 (1h2m17.272664955s) [upload=1077]: Starting upload Aug 7 10:42:17.683365496 (1h2m17.272710483s) [upload=1077]: Done starting upload Aug 7 10:42:17.683570507 (1h2m17.272915484s) [upload=1077]: Uploading segments... Aug 7 10:42:17.683603260 (1h2m17.272948237s) [upload=1077]: Got next segment. Inline: false Aug 7 10:42:17.683641113 (1h2m17.2729861s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:42:17.683645541 (1h2m17.272990528s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:42:18.132597838 (1h2m17.721942825s) [seg_pos={0 0}, upload=1077]: Begin upload segment... Aug 7 10:42:18.132645098 (1h2m17.721990086s) [seg_pos={0 0}, upload=1077]: Done begin upload segment. Aug 7 10:42:18.132665938 (1h2m17.722010925s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.132710503 (1h2m17.72205549s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133023011 (1h2m17.722367988s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133239555 (1h2m17.722584542s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133302897 (1h2m17.722647884s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133594945 (1h2m17.722939932s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133606748 (1h2m17.722951776s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.133929686 (1h2m17.723274663s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134001193 (1h2m17.72334618s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134180617 (1h2m17.723525604s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134272783 (1h2m17.72361777s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134393323 (1h2m17.72373831s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134530746 (1h2m17.723875733s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134611160 (1h2m17.723956137s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.134860547 (1h2m17.724205534s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135084766 (1h2m17.724429753s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.135277394 (1h2m17.724622381s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:18.136035114 (1h2m17.725380091s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Uploading piece... Aug 7 10:42:19.247195966 (1h2m18.836540953s) [upload=1077]: Next returned nil segment Aug 7 10:42:19.247213139 (1h2m18.836558136s) [upload=1077]: Waiting for error group managing segments... Aug 7 10:42:19.529988916 (1h2m19.119333903s) [noise=true , address=64.49.13.170:4726 , piece_id=4JBDCFECWHK3CVEURVPYMNFOKNMW2ZVNOVUKBCTVS2SGTBVP2ZTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.554219786 (1h2m19.143564773s) [noise=true , address=64.49.13.169:4707 , piece_id=AA4ZPBHFY2DS2DBRCVURK5MKMITVLLCUCDWCPP5OK3VE3I62KMAA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:19.617577577 (1h2m19.206922564s) [noise=true , address=64.49.13.155:4916 , piece_id=XNGRMXMX5O4YUXKFD7KTL7JOHM2UNZDACFT3TR2XN6JSMJNEGVFA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.056832030 (1h2m19.646177017s) [noise=true , address=104.36.82.14:4231 , piece_id=VHTDEHXROVNERHSOLMMQJJWIM7BYE5KJYDQCCIFTT4DTVTCGYXEQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.057005792 (1h2m19.64635078s) [noise=true , address=104.36.82.23:4466 , piece_id=LFKMWDLWSZ7D6UNWIZTHSDOPXWY6JZORNKEXA2IHXYNQSROFKI2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.063331355 (1h2m19.652676342s) [noise=true , address=104.36.82.60:4365 , piece_id=UCRMBQ3HYQHNVR7JP7DLW7BQPUAJISDWBASBXUYXLY3G2WZMBPRQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.068968731 (1h2m19.658313718s) [noise=true , address=104.36.82.59:4329 , piece_id=7PHPMOH4ALI7TSIXCRVJH3MWYYY7NKSSO6VSXHV3LNPJ6AMM66YQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069285817 (1h2m19.658630804s) [noise=true , address=104.36.82.16:4316 , piece_id=GOXTEVU4QAKI72JT4XOBP5DOKKDBBEXEU3L7X7X4GXYOWMJPHYAQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.069535785 (1h2m19.658880772s) [noise=true , address=104.36.82.62:4444 , piece_id=A2D4JQPBTI6DO5FYBXIJFCL23OBAZFKZEJCWQUXT36ZGR2NVMDNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.072393092 (1h2m19.661738099s) [noise=true , address=104.36.82.15:4286 , piece_id=OIGTLW34N2XIN7GOLGFRIUWADX7FCDMSBHDB4L4MMJZ3ZVPK5KNA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.116962757 (1h2m19.706307734s) [noise=true , address=45.91.116.10:4105 , piece_id=E4IOOX3PTWEAFQPOHTSZU6L5AI5IHYZXSUUGFF5OW4FJP2NNWQ2A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.138498000 (1h2m19.727842987s) [noise=true , address=104.36.82.39:4727 , piece_id=QANUTLJNCA4JHO4UCRESNB6EMBLQT3J2TQDQC6B7SUN5D2LIUSMQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.154271158 (1h2m19.743616145s) [noise=true , address=104.36.82.8:4995 , piece_id=KFHSQMJL57WRCYH5UFAESAYPHMYAT7XO6TYRXEYQ4TXFJ4ZMSQTA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163211273 (1h2m19.75255625s) [noise=true , address=104.36.82.47:4543 , piece_id=SZUDE3LXCWPNNLAEIS5IJWAFWMRCFD6RONDRVPLH4HFVWF7I7JYQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: <nil> Aug 7 10:42:20.163247472 (1h2m19.752592459s) [seg_pos={0 0}, upload=1077]: Segment reached optimal threshold of 14 pieces. Aug 7 10:42:20.163330972 (1h2m19.752675959s) [noise=true , address=104.36.82.55:4223 , piece_id=G37K3XDLZZE4CGKMPEOQQPYVROICN5DNB2SPDYU2VJLRECBAIMDQ, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164833336 (1h2m19.754178323s) [noise=true , address=104.36.82.8:4003 , piece_id=GFYUJW5RK4OBA6FKJVTHSRFPHJDGZIRZ3MOPLAETASRQL2N4O5JA, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qTLdkqYYRGs1fpm8ZP17cGxPUYJCrspBwffuGbd6JbwcsRf65): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164884093 (1h2m19.75422908s) [noise=true , address=104.36.82.35:4591 , piece_id=NQ5W33B6EKMHHAYRC63ACTCQ7L3XGY5EZWYHBXVBDIWHJDFFWO3Q, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a453d6xSb26epbgqPuco3UPTf9yzoxBeKToCUMNiNHUddAq55): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164980748 (1h2m19.754325725s) [noise=true , address=104.36.82.44:4876 , piece_id=KZTGTNLG4GOQVMHXTXIKKT3N5QM2AZIFT3XG2R7GRQ2GWTDQ756A, seg_pos={0 0}, upload=1077]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 7 10:42:20.164989565 (1h2m19.754334552s) [seg_pos={0 0}, upload=1077]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:42:20.165036384 (1h2m19.754381372s) [upload=1077]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:42:20.165039711 (1h2m19.754384698s) [upload=1077]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:42:20.472172990 (1h2m20.061517977s) [upload=1077]: Done uploading segments... Aug 7 10:42:20.472196515 (1h2m20.061541502s) [upload=1077]: Upload finished. err: <nil> Duration: 3.90458591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X..X.......X...........] duration: 1.917746631s FAIL (2025-08-07 10:42:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.917774123s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.................................X.................] duration: 5.649313922s FAIL (2025-08-07 10:41:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 7 10:27:53.127114657 (47m52.716459644s) [seg_pos={0 0}, upload=826]: Begin upload segment... Aug 7 10:27:53.127165925 (47m52.716510912s) [seg_pos={0 0}, upload=826]: Done begin upload segment. Aug 7 10:27:53.127187276 (47m52.716532263s) [noise=true , address=64.49.13.169:4705 , piece_id=I6EIB45HPBJ2GZEWVYNULPUVAI6N6EH3PRNDUURNZ5R6BDGFDF5Q, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127299070 (47m52.716644077s) [noise=true , address=104.36.82.44:4893 , piece_id=4LVBH2FMQMGIFYGJHZRZRG3JVE7BLYFVL3TXD2C5LSE2RBQ7EJEQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127600216 (47m52.716945203s) [noise=true , address=104.36.82.23:4448 , piece_id=ZWZK423DVDAVGLXHIRNG7WLACPOFTWCI6T53ORCYXVOU2N6CIXLA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127895029 (47m52.717240016s) [noise=true , address=104.36.82.18:4392 , piece_id=QHP4S65VKAU7UPXXSFZOGAVXW7GNZKJJAZMAUDGL7M4ARAW4ICOQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128061197 (47m52.717406184s) [noise=true , address=64.49.13.154:4932 , piece_id=4CAEHUYD7ODVX6VHN72WKMNNYJJEAWOOH63VU2ZQJL7A6JMSXOCQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128226083 (47m52.71757107s) [noise=true , address=104.36.82.55:4204 , piece_id=OTII3KEPJ4U7SO74MIO4LCZTLMK4MP6X4OHHCUT3RDUMAN5GKCNA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128530025 (47m52.717875012s) [noise=true , address=64.49.13.169:4711 , piece_id=3H7WSIIWMYX2WESII22PFCAW65A54N7OIFXRDJPOUPANDQJSTEZA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128548730 (47m52.717893707s) [noise=true , address=104.36.82.62:4434 , piece_id=VDCKJJY2C6W2K3PHUL7RHEZYRPYACNILJT676YJAPWMPK5BOB7HQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128777929 (47m52.718122916s) [noise=true , address=104.36.82.60:4353 , piece_id=XJCEK7BZ5WM2ZESFJUAJJLZBZC5O7YATWFQHO5JPZLX6PPCGH3EA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128864024 (47m52.718209001s) [noise=true , address=104.36.82.9:4016 , piece_id=GBCQOLW3E6WIMSZLFSQFRI27HL63CWNBXSHPZQBARVCIQADVGHEQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129060069 (47m52.718405056s) [noise=true , address=104.36.82.59:4307 , piece_id=ID27GBUMNRQTSML2ZFBEM4RGW7DM7WJQ2YWHYGG57EYNLZWV2O2A, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129179948 (47m52.718524935s) [noise=true , address=45.91.116.9:4266 , piece_id=QMHSPLLVWGMFNKOJFIHQ27IZBZU2QC4EYZRGGNJSYZGKRP2O5CPQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129323142 (47m52.718668129s) [noise=true , address=104.36.82.45:4940 , piece_id=IU6VC7MICK25SKCLFUKXMWBSIN2BZ3JJWKEPQPZZI3VXOS54DUXQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129486815 (47m52.718831792s) [noise=true , address=104.36.82.13:4203 , piece_id=MM7UNHK2BXUVOHV7CJA2TQFPFB2GRAN7C3M5NMEJDYSNP4VXPQHQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129563492 (47m52.718908479s) [noise=true , address=64.49.13.27:4961 , piece_id=5CG6XZXPYHGOLURP3QSN34YHDA7CYJ2QNHYNGNAYOVB3G7NPKYCA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129847866 (47m52.719192853s) [noise=true , address=64.49.13.170:4722 , piece_id=4SA3PTVKAPTK45HDOHUGZSYMBLPTNXACK3QPHLXTXUQC6ES3E43Q, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.130070943 (47m52.71941592s) [noise=true , address=64.49.13.26:4955 , piece_id=D4BEYGWNUS2A2INU4SEGNEYJMEXJXVHPJ3XUBSJT65CB3TDX4XXA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.130303889 (47m52.719648876s) [noise=true , address=104.36.82.61:4374 , piece_id=A24PQW6Z2ZBV2RVJB33EWK7WPQ4OPPTXPGAEEZBHHRARIDCZXPYA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:54.216246642 (47m53.805591629s) [upload=826]: Next returned nil segment Aug 7 10:27:54.216263604 (47m53.805608591s) [upload=826]: Waiting for error group managing segments... Aug 7 10:27:54.493648035 (47m54.082993022s) [noise=true , address=64.49.13.27:4961 , piece_id=5CG6XZXPYHGOLURP3QSN34YHDA7CYJ2QNHYNGNAYOVB3G7NPKYCA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.497002233 (47m54.08634721s) [noise=true , address=64.49.13.154:4932 , piece_id=4CAEHUYD7ODVX6VHN72WKMNNYJJEAWOOH63VU2ZQJL7A6JMSXOCQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.552982929 (47m54.142327916s) [noise=true , address=64.49.13.170:4722 , piece_id=4SA3PTVKAPTK45HDOHUGZSYMBLPTNXACK3QPHLXTXUQC6ES3E43Q, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.566983897 (47m54.156328884s) [noise=true , address=64.49.13.169:4705 , piece_id=I6EIB45HPBJ2GZEWVYNULPUVAI6N6EH3PRNDUURNZ5R6BDGFDF5Q, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.605524535 (47m54.194869522s) [noise=true , address=64.49.13.169:4711 , piece_id=3H7WSIIWMYX2WESII22PFCAW65A54N7OIFXRDJPOUPANDQJSTEZA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.626326125 (47m54.215671112s) [noise=true , address=64.49.13.26:4955 , piece_id=D4BEYGWNUS2A2INU4SEGNEYJMEXJXVHPJ3XUBSJT65CB3TDX4XXA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.037345376 (47m54.626690363s) [noise=true , address=104.36.82.59:4307 , piece_id=ID27GBUMNRQTSML2ZFBEM4RGW7DM7WJQ2YWHYGG57EYNLZWV2O2A, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.041548017 (47m54.630893074s) [noise=true , address=104.36.82.60:4353 , piece_id=XJCEK7BZ5WM2ZESFJUAJJLZBZC5O7YATWFQHO5JPZLX6PPCGH3EA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.052179277 (47m54.641524254s) [noise=true , address=104.36.82.61:4374 , piece_id=A24PQW6Z2ZBV2RVJB33EWK7WPQ4OPPTXPGAEEZBHHRARIDCZXPYA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.065672032 (47m54.655017019s) [noise=true , address=104.36.82.13:4203 , piece_id=MM7UNHK2BXUVOHV7CJA2TQFPFB2GRAN7C3M5NMEJDYSNP4VXPQHQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.086922991 (47m54.676267978s) [noise=true , address=45.91.116.9:4266 , piece_id=QMHSPLLVWGMFNKOJFIHQ27IZBZU2QC4EYZRGGNJSYZGKRP2O5CPQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.153106158 (47m54.742451145s) [noise=true , address=104.36.82.18:4392 , piece_id=QHP4S65VKAU7UPXXSFZOGAVXW7GNZKJJAZMAUDGL7M4ARAW4ICOQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.162982323 (47m54.75232731s) [noise=true , address=104.36.82.62:4434 , piece_id=VDCKJJY2C6W2K3PHUL7RHEZYRPYACNILJT676YJAPWMPK5BOB7HQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.193866313 (47m54.7832113s) [noise=true , address=104.36.82.9:4016 , piece_id=GBCQOLW3E6WIMSZLFSQFRI27HL63CWNBXSHPZQBARVCIQADVGHEQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.193891701 (47m54.783236688s) [seg_pos={0 0}, upload=826]: Segment reached optimal threshold of 14 pieces. Aug 7 10:27:55.194016540 (47m54.783361517s) [noise=true , address=104.36.82.44:4893 , piece_id=4LVBH2FMQMGIFYGJHZRZRG3JVE7BLYFVL3TXD2C5LSE2RBQ7EJEQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194078669 (47m54.783423646s) [noise=true , address=104.36.82.23:4448 , piece_id=ZWZK423DVDAVGLXHIRNG7WLACPOFTWCI6T53ORCYXVOU2N6CIXLA, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194123023 (47m54.78346801s) [noise=true , address=104.36.82.45:4940 , piece_id=IU6VC7MICK25SKCLFUKXMWBSIN2BZ3JJWKEPQPZZI3VXOS54DUXQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ajfrKxYoBvXFurqvTkLDkiY39pAWGgmsMXfdBMVgDKvuhWRdr): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194163461 (47m54.783508448s) [noise=true , address=104.36.82.55:4204 , piece_id=OTII3KEPJ4U7SO74MIO4LCZTLMK4MP6X4OHHCUT3RDUMAN5GKCNA, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194176856 (47m54.783521843s) [seg_pos={0 0}, upload=826]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:27:55.194239576 (47m54.783584563s) [upload=826]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:27:55.194244346 (47m54.783589333s) [upload=826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:55.600768716 (47m55.190113704s) [upload=826]: Done uploading segments... Aug 7 10:27:55.600785469 (47m55.190130456s) [upload=826]: Upload finished. err: <nil> Aug 7 10:29:03.858161386 (49m3.447506373s) [upload=845]: Starting upload Aug 7 10:29:03.858203167 (49m3.447548154s) [upload=845]: Done starting upload Aug 7 10:29:03.858315672 (49m3.447660729s) [upload=845]: Uploading segments... Aug 7 10:29:03.858419040 (49m3.447764087s) [upload=845]: Got next segment. Inline: false Aug 7 10:29:03.858489424 (49m3.447834471s) [upload=845]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:03.858495986 (49m3.447840993s) [upload=845]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:29:04.075640723 (49m3.66498571s) [upload=845]: Next segment err: metaclient: Too Many Requests Aug 7 10:29:04.075657755 (49m3.665002742s) [upload=845]: Done uploading segments... Aug 7 10:29:04.075671001 (49m3.665015988s) [upload=845]: Upload finished. err: metaclient: Too Many Requests Duration: 5.64933995s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..X.......X..........] duration: 2.110459884s FAIL (2025-08-07 10:40:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.11047896s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.................................X................] duration: 5.928631488s FAIL (2025-08-07 10:40:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 7 10:27:53.127114657 (47m52.716459644s) [seg_pos={0 0}, upload=826]: Begin upload segment... Aug 7 10:27:53.127165925 (47m52.716510912s) [seg_pos={0 0}, upload=826]: Done begin upload segment. Aug 7 10:27:53.127187276 (47m52.716532263s) [noise=true , address=64.49.13.169:4705 , piece_id=I6EIB45HPBJ2GZEWVYNULPUVAI6N6EH3PRNDUURNZ5R6BDGFDF5Q, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127299070 (47m52.716644077s) [noise=true , address=104.36.82.44:4893 , piece_id=4LVBH2FMQMGIFYGJHZRZRG3JVE7BLYFVL3TXD2C5LSE2RBQ7EJEQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127600216 (47m52.716945203s) [noise=true , address=104.36.82.23:4448 , piece_id=ZWZK423DVDAVGLXHIRNG7WLACPOFTWCI6T53ORCYXVOU2N6CIXLA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.127895029 (47m52.717240016s) [noise=true , address=104.36.82.18:4392 , piece_id=QHP4S65VKAU7UPXXSFZOGAVXW7GNZKJJAZMAUDGL7M4ARAW4ICOQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128061197 (47m52.717406184s) [noise=true , address=64.49.13.154:4932 , piece_id=4CAEHUYD7ODVX6VHN72WKMNNYJJEAWOOH63VU2ZQJL7A6JMSXOCQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128226083 (47m52.71757107s) [noise=true , address=104.36.82.55:4204 , piece_id=OTII3KEPJ4U7SO74MIO4LCZTLMK4MP6X4OHHCUT3RDUMAN5GKCNA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128530025 (47m52.717875012s) [noise=true , address=64.49.13.169:4711 , piece_id=3H7WSIIWMYX2WESII22PFCAW65A54N7OIFXRDJPOUPANDQJSTEZA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128548730 (47m52.717893707s) [noise=true , address=104.36.82.62:4434 , piece_id=VDCKJJY2C6W2K3PHUL7RHEZYRPYACNILJT676YJAPWMPK5BOB7HQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128777929 (47m52.718122916s) [noise=true , address=104.36.82.60:4353 , piece_id=XJCEK7BZ5WM2ZESFJUAJJLZBZC5O7YATWFQHO5JPZLX6PPCGH3EA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.128864024 (47m52.718209001s) [noise=true , address=104.36.82.9:4016 , piece_id=GBCQOLW3E6WIMSZLFSQFRI27HL63CWNBXSHPZQBARVCIQADVGHEQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129060069 (47m52.718405056s) [noise=true , address=104.36.82.59:4307 , piece_id=ID27GBUMNRQTSML2ZFBEM4RGW7DM7WJQ2YWHYGG57EYNLZWV2O2A, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129179948 (47m52.718524935s) [noise=true , address=45.91.116.9:4266 , piece_id=QMHSPLLVWGMFNKOJFIHQ27IZBZU2QC4EYZRGGNJSYZGKRP2O5CPQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129323142 (47m52.718668129s) [noise=true , address=104.36.82.45:4940 , piece_id=IU6VC7MICK25SKCLFUKXMWBSIN2BZ3JJWKEPQPZZI3VXOS54DUXQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129486815 (47m52.718831792s) [noise=true , address=104.36.82.13:4203 , piece_id=MM7UNHK2BXUVOHV7CJA2TQFPFB2GRAN7C3M5NMEJDYSNP4VXPQHQ, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129563492 (47m52.718908479s) [noise=true , address=64.49.13.27:4961 , piece_id=5CG6XZXPYHGOLURP3QSN34YHDA7CYJ2QNHYNGNAYOVB3G7NPKYCA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.129847866 (47m52.719192853s) [noise=true , address=64.49.13.170:4722 , piece_id=4SA3PTVKAPTK45HDOHUGZSYMBLPTNXACK3QPHLXTXUQC6ES3E43Q, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.130070943 (47m52.71941592s) [noise=true , address=64.49.13.26:4955 , piece_id=D4BEYGWNUS2A2INU4SEGNEYJMEXJXVHPJ3XUBSJT65CB3TDX4XXA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:53.130303889 (47m52.719648876s) [noise=true , address=104.36.82.61:4374 , piece_id=A24PQW6Z2ZBV2RVJB33EWK7WPQ4OPPTXPGAEEZBHHRARIDCZXPYA, seg_pos={0 0}, upload=826]: Uploading piece... Aug 7 10:27:54.216246642 (47m53.805591629s) [upload=826]: Next returned nil segment Aug 7 10:27:54.216263604 (47m53.805608591s) [upload=826]: Waiting for error group managing segments... Aug 7 10:27:54.493648035 (47m54.082993022s) [noise=true , address=64.49.13.27:4961 , piece_id=5CG6XZXPYHGOLURP3QSN34YHDA7CYJ2QNHYNGNAYOVB3G7NPKYCA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.497002233 (47m54.08634721s) [noise=true , address=64.49.13.154:4932 , piece_id=4CAEHUYD7ODVX6VHN72WKMNNYJJEAWOOH63VU2ZQJL7A6JMSXOCQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.552982929 (47m54.142327916s) [noise=true , address=64.49.13.170:4722 , piece_id=4SA3PTVKAPTK45HDOHUGZSYMBLPTNXACK3QPHLXTXUQC6ES3E43Q, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.566983897 (47m54.156328884s) [noise=true , address=64.49.13.169:4705 , piece_id=I6EIB45HPBJ2GZEWVYNULPUVAI6N6EH3PRNDUURNZ5R6BDGFDF5Q, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.605524535 (47m54.194869522s) [noise=true , address=64.49.13.169:4711 , piece_id=3H7WSIIWMYX2WESII22PFCAW65A54N7OIFXRDJPOUPANDQJSTEZA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:54.626326125 (47m54.215671112s) [noise=true , address=64.49.13.26:4955 , piece_id=D4BEYGWNUS2A2INU4SEGNEYJMEXJXVHPJ3XUBSJT65CB3TDX4XXA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.037345376 (47m54.626690363s) [noise=true , address=104.36.82.59:4307 , piece_id=ID27GBUMNRQTSML2ZFBEM4RGW7DM7WJQ2YWHYGG57EYNLZWV2O2A, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.041548017 (47m54.630893074s) [noise=true , address=104.36.82.60:4353 , piece_id=XJCEK7BZ5WM2ZESFJUAJJLZBZC5O7YATWFQHO5JPZLX6PPCGH3EA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.052179277 (47m54.641524254s) [noise=true , address=104.36.82.61:4374 , piece_id=A24PQW6Z2ZBV2RVJB33EWK7WPQ4OPPTXPGAEEZBHHRARIDCZXPYA, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.065672032 (47m54.655017019s) [noise=true , address=104.36.82.13:4203 , piece_id=MM7UNHK2BXUVOHV7CJA2TQFPFB2GRAN7C3M5NMEJDYSNP4VXPQHQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.086922991 (47m54.676267978s) [noise=true , address=45.91.116.9:4266 , piece_id=QMHSPLLVWGMFNKOJFIHQ27IZBZU2QC4EYZRGGNJSYZGKRP2O5CPQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.153106158 (47m54.742451145s) [noise=true , address=104.36.82.18:4392 , piece_id=QHP4S65VKAU7UPXXSFZOGAVXW7GNZKJJAZMAUDGL7M4ARAW4ICOQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.162982323 (47m54.75232731s) [noise=true , address=104.36.82.62:4434 , piece_id=VDCKJJY2C6W2K3PHUL7RHEZYRPYACNILJT676YJAPWMPK5BOB7HQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.193866313 (47m54.7832113s) [noise=true , address=104.36.82.9:4016 , piece_id=GBCQOLW3E6WIMSZLFSQFRI27HL63CWNBXSHPZQBARVCIQADVGHEQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: <nil> Aug 7 10:27:55.193891701 (47m54.783236688s) [seg_pos={0 0}, upload=826]: Segment reached optimal threshold of 14 pieces. Aug 7 10:27:55.194016540 (47m54.783361517s) [noise=true , address=104.36.82.44:4893 , piece_id=4LVBH2FMQMGIFYGJHZRZRG3JVE7BLYFVL3TXD2C5LSE2RBQ7EJEQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194078669 (47m54.783423646s) [noise=true , address=104.36.82.23:4448 , piece_id=ZWZK423DVDAVGLXHIRNG7WLACPOFTWCI6T53ORCYXVOU2N6CIXLA, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194123023 (47m54.78346801s) [noise=true , address=104.36.82.45:4940 , piece_id=IU6VC7MICK25SKCLFUKXMWBSIN2BZ3JJWKEPQPZZI3VXOS54DUXQ, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ajfrKxYoBvXFurqvTkLDkiY39pAWGgmsMXfdBMVgDKvuhWRdr): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194163461 (47m54.783508448s) [noise=true , address=104.36.82.55:4204 , piece_id=OTII3KEPJ4U7SO74MIO4LCZTLMK4MP6X4OHHCUT3RDUMAN5GKCNA, seg_pos={0 0}, upload=826]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rBZH6aLHsnWh22uNzaMiMwmLJCDMn4bYbNC5jRG7KCEuRfqpH): protocol: expected piece hash; context canceled; EOF Aug 7 10:27:55.194176856 (47m54.783521843s) [seg_pos={0 0}, upload=826]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:27:55.194239576 (47m54.783584563s) [upload=826]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:27:55.194244346 (47m54.783589333s) [upload=826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:55.600768716 (47m55.190113704s) [upload=826]: Done uploading segments... Aug 7 10:27:55.600785469 (47m55.190130456s) [upload=826]: Upload finished. err: <nil> Aug 7 10:29:03.858161386 (49m3.447506373s) [upload=845]: Starting upload Aug 7 10:29:03.858203167 (49m3.447548154s) [upload=845]: Done starting upload Aug 7 10:29:03.858315672 (49m3.447660729s) [upload=845]: Uploading segments... Aug 7 10:29:03.858419040 (49m3.447764087s) [upload=845]: Got next segment. Inline: false Aug 7 10:29:03.858489424 (49m3.447834471s) [upload=845]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:03.858495986 (49m3.447840993s) [upload=845]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:29:04.075640723 (49m3.66498571s) [upload=845]: Next segment err: metaclient: Too Many Requests Aug 7 10:29:04.075657755 (49m3.665002742s) [upload=845]: Done uploading segments... Aug 7 10:29:04.075671001 (49m3.665015988s) [upload=845]: Upload finished. err: metaclient: Too Many Requests Duration: 5.928654153s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X..X.......X.........] duration: 2.168435153s FAIL (2025-08-07 10:40:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 2.168506941s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)