Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................XX.....................X.................] duration: 5.823724134s FAIL (2025-08-08 06:37:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.823750264s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X........X....X......................................] duration: 1.848624653s FAIL (2025-08-08 06:37:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.848652146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................XX.....................X................] duration: 5.785182004s FAIL (2025-08-08 06:37:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.78520684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X........X....X.....................................] duration: 2.002857572s FAIL (2025-08-08 06:36:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 2.002885955s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX.....................X...............] duration: 5.696210063s FAIL (2025-08-08 06:36:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.696232968s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X........X....X....................................] duration: 1.868529811s FAIL (2025-08-08 06:36:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.868557163s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.....................XX.....................X..............] duration: 5.620538998s FAIL (2025-08-08 06:35:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.620566381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X........X....X...................................] duration: 1.853161574s FAIL (2025-08-08 06:35:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.853182633s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X........X....X..................................] duration: 1.844535359s FAIL (2025-08-08 06:35:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.844555949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X........X....X.................................] duration: 2.066019568s FAIL (2025-08-08 06:34:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 2.066045509s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.....................XX.....................X.............] duration: 5.56773938s FAIL (2025-08-08 06:34:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.567764688s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X............X........X....X................................] duration: 2.027348733s FAIL (2025-08-08 06:34:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 2.02737361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X............X........X....X...............................] duration: 1.828514266s FAIL (2025-08-08 06:33:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.828534425s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.....................XX.....................X............] duration: 5.610542493s FAIL (2025-08-08 06:33:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.610573453s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.....................XX.....................X...........] duration: 5.751790116s FAIL (2025-08-08 06:32:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.751818269s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X............X........X....X..............................] duration: 1.856644526s FAIL (2025-08-08 06:32:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.856673201s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.439815132s FAIL (2025-08-08 06:32:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.439844417s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.....................XX.....................X..........] duration: 5.54032675s FAIL (2025-08-08 06:31:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.540355385s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.11284545s FAIL (2025-08-08 06:31:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.112879695s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X............X........X....X.............................] duration: 1.849643623s FAIL (2025-08-08 06:31:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.849671316s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.....................XX.....................X.........] duration: 5.528779585s FAIL (2025-08-08 06:31:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.52880293s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.870612241s FAIL (2025-08-08 06:31:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.870636679s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X............X........X....X............................] duration: 1.876908439s FAIL (2025-08-08 06:30:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.876948686s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.886617081s FAIL (2025-08-08 06:30:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.886641639s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.....................XX.....................X........] duration: 5.549933657s FAIL (2025-08-08 06:30:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.549958564s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.844587047s FAIL (2025-08-08 06:30:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.844617176s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.....................XX.....................X.......] duration: 5.806604732s FAIL (2025-08-08 06:29:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.806632224s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.072191176s FAIL (2025-08-08 06:29:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.072212506s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X............X........X....X...........................] duration: 2.009557139s FAIL (2025-08-08 06:29:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 2.009617475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.504158059s FAIL (2025-08-08 06:29:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.504181263s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X............X........X....X..........................] duration: 1.99077766s FAIL (2025-08-08 06:29:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.990802739s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.....................XX.....................X......] duration: 5.760587968s FAIL (2025-08-08 06:28:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.760616321s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.089085691s FAIL (2025-08-08 06:28:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.089108675s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.....................XX.....................X.....] duration: 5.519566376s FAIL (2025-08-08 06:28:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.519594569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X............X........X....X.........................] duration: 1.854172227s FAIL (2025-08-08 06:28:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.854200281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.890458834s FAIL (2025-08-08 06:28:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.890481017s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X............X........X....X........................] duration: 2.011905346s FAIL (2025-08-08 06:27:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 2.01192807s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.097104289s FAIL (2025-08-08 06:27:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.097121s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.....................XX.....................X....] duration: 5.602051795s FAIL (2025-08-08 06:27:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.602072786s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X............X........X....X.......................] duration: 1.812967667s FAIL (2025-08-08 06:27:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.81298959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.....................XX.....................X...] duration: 5.619552009s FAIL (2025-08-08 06:26:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.619571175s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.854359007s FAIL (2025-08-08 06:26:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.854379716s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X............X........X....X......................] duration: 1.828029629s FAIL (2025-08-08 06:26:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.828053473s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.....................XX.....................X..] duration: 5.745736692s FAIL (2025-08-08 06:26:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.745756189s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X............X........X....X.....................] duration: 1.849344922s FAIL (2025-08-08 06:26:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.849386441s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X............X........X....X....................] duration: 1.815785259s FAIL (2025-08-08 06:25:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.815809677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.924645023s FAIL (2025-08-08 06:25:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.924670353s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.....................XX.....................X.] duration: 5.622156113s FAIL (2025-08-08 06:25:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.622182052s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.414534049s FAIL (2025-08-08 06:25:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.41456626s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.....................XX.....................X] duration: 5.571751847s FAIL (2025-08-08 06:25:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bacfbfd221641819eaab03c463936b5d8ba6406052fd50d9e3b1f94970fdcf7c != before 07fc20e5146abe15f623d853e7cd07d837507ecc1f12ea4c2d9a5fce9d17f8ff ======LOGS====== 02604114 (20h44m5.091949101s) [upload=21470]: Upload finished. err: <nil> Aug 8 06:24:59.979823720 (20h44m59.569168707s) [upload=21486]: Starting upload Aug 8 06:24:59.979865490 (20h44m59.569210477s) [upload=21486]: Done starting upload Aug 8 06:24:59.979951044 (20h44m59.569296031s) [upload=21486]: Uploading segments... Aug 8 06:24:59.980045365 (20h44m59.569390342s) [upload=21486]: Got next segment. Inline: false Aug 8 06:24:59.980089649 (20h44m59.569434636s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:24:59.980093957 (20h44m59.569438944s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:25:00.434063013 (20h45m0.023408s) [seg_pos={0 0}, upload=21486]: Begin upload segment... Aug 8 06:25:00.434134459 (20h45m0.023479447s) [seg_pos={0 0}, upload=21486]: Done begin upload segment. Aug 8 06:25:00.434160650 (20h45m0.023505637s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434174917 (20h45m0.023519904s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434581145 (20h45m0.023926132s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434624708 (20h45m0.023969695s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434880818 (20h45m0.024225805s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.434940893 (20h45m0.02428588s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435245796 (20h45m0.024590783s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435563584 (20h45m0.024908571s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.435820165 (20h45m0.025165153s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436139406 (20h45m0.025484393s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436391599 (20h45m0.025736596s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436470339 (20h45m0.025815326s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436738733 (20h45m0.02608372s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.436969445 (20h45m0.026314432s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437196228 (20h45m0.026541215s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437442570 (20h45m0.026787557s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437666568 (20h45m0.027011555s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:00.437930604 (20h45m0.027275591s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Uploading piece... Aug 8 06:25:01.566878746 (20h45m1.156223733s) [upload=21486]: Next returned nil segment Aug 8 06:25:01.566898764 (20h45m1.156243761s) [upload=21486]: Waiting for error group managing segments... Aug 8 06:25:01.857141947 (20h45m1.446486944s) [noise=true , address=193.149.164.143:4697 , piece_id=3WKPYROVS353TR64PZCEOCUV7E5WECZ7WCPPWE7N73P4NRJOWECQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.940304780 (20h45m1.529649778s) [noise=true , address=64.49.13.27:4967 , piece_id=PSMBLBAR4USGZNODWWC533RRMYL6JVTTQ53UWAMEPIWGDNU7RANQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:01.998586347 (20h45m1.587931344s) [noise=true , address=64.49.13.170:4725 , piece_id=J4UWBXFMD7PJHQLAZEHFEG5GRS3OG4RTJGCVTIKZTGOFSFUTDYFA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.326704008 (20h45m1.916048995s) [noise=true , address=104.36.82.23:4464 , piece_id=43OVIPNRVQZYGATXOYRVVP4CIA3ABKKGKABFSLWKJF52QO3IP2QQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.350886138 (20h45m1.940231135s) [noise=true , address=104.36.82.58:4274 , piece_id=A5CYMEIZRWKPTSVHIKRN6V6EOMVWOMTCGJGAVA4MJKJBD5FVD2OQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.406707587 (20h45m1.996052584s) [noise=true , address=104.36.82.60:4351 , piece_id=5NBLMWX57JU24JDF4F57SHDR5DMV5GACDIUJNVCCVJ4Z7PEEUGBQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.408342776 (20h45m1.997687773s) [noise=true , address=104.36.82.9:4016 , piece_id=XMUPDZQHBI45KKI7VTX5SAAEZC4XEAEJJ4ITHH7ZOP34CF457NPQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.421586376 (20h45m2.010931383s) [noise=true , address=104.36.82.47:4531 , piece_id=SBQH22AAGARKFB54QGHIIZAWLUAOMBON5LPFEL2OKHJYKACPIOHQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.422439339 (20h45m2.011784336s) [noise=true , address=104.36.82.39:4734 , piece_id=OMFQL25S77GIM5UF7OPNOYOKLQUTFUIHXP7VY7NBMAV7FX5WUBDA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.434222845 (20h45m2.023567832s) [noise=true , address=104.36.82.39:4745 , piece_id=XRSBV5E4TP6TT6QY6GWKEOW2E6W7PUDQ6IPZ2CJ5KPYFC4LFO75A, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.438956683 (20h45m2.02830167s) [noise=true , address=104.36.82.43:4860 , piece_id=77STACCTYDDKZAYSVYUF6VJQOPZDWCJCKEXVUXXTHCC7QKAVCHRQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.440033904 (20h45m2.029378901s) [noise=true , address=104.36.82.5:4853 , piece_id=AIOY7ADAQ34AOJ2AKW7SI2LUAMUFMGHP24TOVALJGFPLH2Q4R7JQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.443379906 (20h45m2.032724903s) [noise=true , address=104.36.82.6:4890 , piece_id=LHSPKUTARWTM2IOTW66VIWNTRQAQJY2Q7AGT3JSORWTMTKNNSSEQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459857654 (20h45m2.049202641s) [noise=true , address=104.36.82.21:4504 , piece_id=62BRSZTJB2EM3GBUGST34T5GF2C77WLDJP4JMYH7NNEBO4EOVZAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: <nil> Aug 8 06:25:02.459900487 (20h45m2.049245484s) [seg_pos={0 0}, upload=21486]: Segment reached optimal threshold of 14 pieces. Aug 8 06:25:02.460197525 (20h45m2.049542512s) [noise=true , address=104.36.82.44:4901 , piece_id=E3LYEVFNRS7YH7CTF3F4WTRYX5WTQD7GX4FC77EC2ZDVHCW5FTVQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460427816 (20h45m2.049772813s) [noise=true , address=104.36.82.62:4423 , piece_id=LNA67F446K2MH2ZGJSUOSCWOGUYXDUXS4IZ4ON7YFJC62DXG5YUA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460697351 (20h45m2.050042349s) [noise=true , address=104.36.82.37:4679 , piece_id=3CA67CROHSB4S5QWYBSSFQJEZJVECR2AGZOX56F2JBYLUYSRDWAQ, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VHQihNGcx6bTvwitH9PCSqyuKWuchdYhYzZXwSuoruQFByGoj): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460865804 (20h45m2.050210791s) [noise=true , address=104.36.82.13:4192 , piece_id=AECBIHL7ZYVJXTGQ6DVPM3T4XKDZGGYA37SEAENU6CWVNOTIMCSA, seg_pos={0 0}, upload=21486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nKVH5WuEdpXN7Z1rbD6yzv3HF7Fi9Gm5FBbc4gMqj93aFjuN3): protocol: expected piece hash; context canceled; EOF Aug 8 06:25:02.460918334 (20h45m2.050263331s) [seg_pos={0 0}, upload=21486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:25:02.461039717 (20h45m2.050384714s) [upload=21486]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:25:02.461046600 (20h45m2.050391587s) [upload=21486]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:25:02.747783133 (20h45m2.33712813s) [upload=21486]: Done uploading segments... Aug 8 06:25:02.747807529 (20h45m2.337152517s) [upload=21486]: Upload finished. err: <nil> Duration: 5.571769922s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)