Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..X.....X..............................................X..] duration:
5.725441227s
FAIL (2025-08-10 11:51:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.725467296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..X.....X..............................................X.] duration:
5.755434239s
FAIL (2025-08-10 11:51:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.755464586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration:
1.83122199s
FAIL (2025-08-10 11:50:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.831249946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..X.....X..............................................X] duration:
5.877049146s
FAIL (2025-08-10 11:50:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.877078572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...X..X.....X..............................................] duration:
5.605372423s
FAIL (2025-08-10 11:50:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.605399344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration:
1.872270756s
FAIL (2025-08-10 11:49:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872302857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X......................X........] duration:
1.827684303s
FAIL (2025-08-10 11:49:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827710332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...X..X.....X.............................................] duration:
5.836481774s
FAIL (2025-08-10 11:49:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.836508685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...X..X.....X............................................] duration:
5.58401508s
FAIL (2025-08-10 11:48:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.584031752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration:
1.829102247s
FAIL (2025-08-10 11:48:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829131953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...X..X.....X...........................................] duration:
5.753268245s
FAIL (2025-08-10 11:48:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.753292071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......................X......] duration:
1.847987697s
FAIL (2025-08-10 11:48:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848012835s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...X..X.....X..........................................] duration:
5.613625685s
FAIL (2025-08-10 11:48:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.613654359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration:
1.815572066s
FAIL (2025-08-10 11:47:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.815602094s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X......................X....] duration:
1.836080588s
FAIL (2025-08-10 11:47:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836102791s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...X..X.....X.........................................] duration:
5.60750364s
FAIL (2025-08-10 11:46:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.607536543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......................X...] duration:
1.854525096s
FAIL (2025-08-10 11:46:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854549421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.....X...X..X.....X........................................] duration:
5.72005684s
FAIL (2025-08-10 11:46:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.72008244s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.....X...X..X.....X.......................................] duration:
5.80685885s
FAIL (2025-08-10 11:45:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.80688403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......................X..] duration:
1.83484837s
FAIL (2025-08-10 11:45:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834920698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......................X.] duration:
1.971731122s
FAIL (2025-08-10 11:44:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.97177301s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.....X...X..X.....X......................................] duration:
5.82232309s
FAIL (2025-08-10 11:44:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.822349209s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.....X...X..X.....X.....................................] duration:
5.750508652s
FAIL (2025-08-10 11:44:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.750541024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
862.225648ms
FAIL (2025-08-10 11:43:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.247529ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.....X...X..X.....X....................................] duration:
5.543765257s
FAIL (2025-08-10 11:43:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.543790596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.....X...X..X.....X...................................] duration:
5.703792642s
FAIL (2025-08-10 11:43:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.703819212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.839734235s
FAIL (2025-08-10 11:42:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.839758641s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.....X...X..X.....X..................................] duration:
5.574758168s
FAIL (2025-08-10 11:42:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.574777484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.866008328s
FAIL (2025-08-10 11:42:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.866034108s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X......................................X....................] duration:
1.832215844s
FAIL (2025-08-10 11:41:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.832240241s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X.....X...X..X.....X.................................] duration:
5.589410222s
FAIL (2025-08-10 11:41:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.589428738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X.....X...X..X.....X................................] duration:
5.933042981s
FAIL (2025-08-10 11:40:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.933067937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X......................................X...................] duration:
1.813527373s
FAIL (2025-08-10 11:40:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.8135567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X......................................X..................] duration:
1.828290059s
FAIL (2025-08-10 11:39:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.828319486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X.....X...X..X.....X...............................] duration:
5.537076244s
FAIL (2025-08-10 11:39:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.537102907s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X.....X...X..X.....X..............................] duration:
5.747733333s
FAIL (2025-08-10 11:38:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.747753811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X......................................X.................] duration:
1.81528154s
FAIL (2025-08-10 11:38:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.815309425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X......................................X................] duration:
1.837851616s
FAIL (2025-08-10 11:38:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.837875873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X.....X...X..X.....X.............................] duration:
6.413798295s
FAIL (2025-08-10 11:37:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.413819927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X......................................X...............] duration:
1.977040731s
FAIL (2025-08-10 11:37:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.977068163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X.....X...X..X.....X............................] duration:
5.553722587s
FAIL (2025-08-10 11:36:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.553749689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X......................................X..............] duration:
2.021029462s
FAIL (2025-08-10 11:36:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 2.021056625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.....X...X..X.....X...........................] duration:
5.856411465s
FAIL (2025-08-10 11:36:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.856434418s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X.....X...X..X.....X..........................] duration:
5.612979405s
FAIL (2025-08-10 11:35:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.61300307s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X......................................X.............] duration:
1.912477908s
FAIL (2025-08-10 11:35:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.912497626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X.....X...X..X.....X.........................] duration:
5.831162905s
FAIL (2025-08-10 11:35:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.831186089s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X......................................X............] duration:
1.932505057s
FAIL (2025-08-10 11:34:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.932529804s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X.....X...X..X.....X........................] duration:
5.617685628s
FAIL (2025-08-10 11:34:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.617704414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X......................................X...........] duration:
1.80378857s
FAIL (2025-08-10 11:34:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9dc86c764f5a51b014a7aae361b7c04aa697ef5e240dca3fcd69888870f7b3ce != before c7e83e75e7b150c67931f56656d97d74285a7cd3ae55f0a2afe657dc50ab3856 ======LOGS====== Aug 10 11:26:43.674282987 (42h0m38.105363108s) [upload=43813]: Starting upload Aug 10 11:26:43.674346017 (42h0m38.105426138s) [upload=43813]: Done starting upload Aug 10 11:26:43.674416331 (42h0m38.105496462s) [upload=43813]: Uploading segments... Aug 10 11:26:43.674461748 (42h0m38.10554188s) [upload=43813]: Got next segment. Inline: true Aug 10 11:26:43.674465485 (42h0m38.105545617s) [upload=43813]: Waiting for error group managing segments... Aug 10 11:26:43.674501915 (42h0m38.105582036s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:26:43.674505653 (42h0m38.105585784s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:26:43.674508208 (42h0m38.105588339s) [upload=43813]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:26:43.941577846 (42h0m38.372657977s) [upload=43813]: Done uploading segments... Aug 10 11:26:43.941596843 (42h0m38.372676974s) [upload=43813]: Upload finished. err: <nil>
Duration: 1.803811555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X.....X...X..X.....X.......................] duration:
5.602705977s
FAIL (2025-08-10 11:33:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:18:22.866270733 (41h52m17.297350894s) [upload=43667]: Starting upload Aug 10 11:18:22.866370123 (41h52m17.297450254s) [upload=43667]: Done starting upload Aug 10 11:18:22.866451759 (41h52m17.297531951s) [upload=43667]: Uploading segments... Aug 10 11:18:22.866829732 (41h52m17.297909903s) [upload=43667]: Got next segment. Inline: false Aug 10 11:18:22.866944302 (41h52m17.298024483s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:18:22.866953760 (41h52m17.298033931s) [upload=43667]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 11:18:23.092028658 (41h52m17.523108789s) [upload=43667]: Next segment err: metaclient: Too Many Requests Aug 10 11:18:23.092051381 (41h52m17.523131502s) [upload=43667]: Done uploading segments... Aug 10 11:18:23.092066090 (41h52m17.523146211s) [upload=43667]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.602732177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|