Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.568880841s
FAIL (2025-08-17 10:58:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.568916058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.714607754s
FAIL (2025-08-17 10:57:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.714624567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [XX......................................................X...] duration:
1.829558482s
FAIL (2025-08-17 10:57:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.829582427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [XXX......................................................X..] duration:
1.855340331s
FAIL (2025-08-17 10:57:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855365298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.XXX......................................................X.] duration:
1.833138804s
FAIL (2025-08-17 10:56:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833167568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.815129517s
FAIL (2025-08-17 10:56:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.815157459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..XXX......................................................X] duration:
857.67348ms
FAIL (2025-08-17 10:56:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:56:22.847149645 (209h30m17.278229766s) [upload=217900]: Starting upload Aug 17 10:56:22.847194742 (209h30m17.278274863s) [upload=217900]: Done starting upload Aug 17 10:56:22.847248104 (209h30m17.278328235s) [upload=217900]: Uploading segments... Aug 17 10:56:22.847284183 (209h30m17.278364314s) [upload=217900]: Got next segment. Inline: true Aug 17 10:56:22.847288301 (209h30m17.278368432s) [upload=217900]: Waiting for error group managing segments... Aug 17 10:56:22.847322295 (209h30m17.278402426s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:56:22.847326484 (209h30m17.278406605s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:56:22.847328939 (209h30m17.27840906s) [upload=217900]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:56:23.060314821 (209h30m17.491394952s) [upload=217900]: Done uploading segments... Aug 17 10:56:23.060334047 (209h30m17.491414178s) [upload=217900]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.690734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.468020775s
FAIL (2025-08-17 10:56:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.468036276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
1.883186371s
FAIL (2025-08-17 10:55:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883213042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
1.800151927s
FAIL (2025-08-17 10:55:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.800171855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.911842629s
FAIL (2025-08-17 10:55:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.911870492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
1.853684052s
FAIL (2025-08-17 10:55:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853713069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.575553859s
FAIL (2025-08-17 10:55:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.575576862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
1.88991157s
FAIL (2025-08-17 10:54:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.889941698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.505673698s
FAIL (2025-08-17 10:54:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.505702214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
1.861629097s
FAIL (2025-08-17 10:53:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861645258s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.821434081s
FAIL (2025-08-17 10:53:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.821462255s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.......XXX.................................................] duration:
1.819348105s
FAIL (2025-08-17 10:52:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.819380548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.5153478s
FAIL (2025-08-17 10:52:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.515386775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.......XXX................................................] duration:
1.960395456s
FAIL (2025-08-17 10:52:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.960426565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.......XXX...............................................] duration:
2.035376268s
FAIL (2025-08-17 10:51:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.035409592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.588486596s
FAIL (2025-08-17 10:51:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.588518896s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.......XXX..............................................] duration:
1.853537905s
FAIL (2025-08-17 10:51:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.853565868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.677040163s
FAIL (2025-08-17 10:51:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 5.677067535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
3.92237406s
FAIL (2025-08-17 10:50:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 10:50:18.725967773 (209h24m13.157047894s) [upload=217794]: Starting upload
Aug 17 10:50:18.726014532 (209h24m13.157094664s) [upload=217794]: Done starting upload
Aug 17 10:50:18.726094175 (209h24m13.157174296s) [upload=217794]: Uploading segments...
Aug 17 10:50:18.726205418 (209h24m13.157285549s) [upload=217794]: Got next segment. Inline: false
Aug 17 10:50:18.726239924 (209h24m13.157320055s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 10:50:18.726244293 (209h24m13.157324414s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 10:50:19.171508843 (209h24m13.602588974s) [seg_pos={0 0}, upload=217794]: Begin upload segment...
Aug 17 10:50:19.171549270 (209h24m13.602629401s) [seg_pos={0 0}, upload=217794]: Done begin upload segment.
Aug 17 10:50:19.171573306 (209h24m13.602653427s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.171653629 (209h24m13.60273376s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172121274 (209h24m13.603201405s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172137966 (209h24m13.603218098s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172504888 (209h24m13.603585009s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172627052 (209h24m13.603707183s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172796727 (209h24m13.603876858s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.172940101 (209h24m13.604020232s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173061252 (209h24m13.604141383s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173280151 (209h24m13.604360282s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173342481 (209h24m13.604422612s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173556530 (209h24m13.604636661s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173593251 (209h24m13.604673382s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173894337 (209h24m13.604974468s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.173908624 (209h24m13.604988745s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174163071 (209h24m13.605243202s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174166678 (209h24m13.605246809s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:19.174394424 (209h24m13.605474555s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Uploading piece...
Aug 17 10:50:20.329116981 (209h24m14.760197112s) [upload=217794]: Next returned nil segment
Aug 17 10:50:20.329134665 (209h24m14.760214796s) [upload=217794]: Waiting for error group managing segments...
Aug 17 10:50:20.637776714 (209h24m15.068856846s) [noise=true , address=66.23.193.175:4556 , piece_id=OVEJIUXVL2XXOJ4FI2ZDAINKAEI5FVVTG6DGTFM2KLK4MVYRP4AA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.016285396 (209h24m15.447365527s) [noise=true , address=79.127.220.97:4385 , piece_id=NCRMUHIBVM536ECNMFTLINCQZN5OW65CY6Y7UWX3PE3K5IC4MRZQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.026205016 (209h24m15.457285137s) [noise=true , address=79.127.220.101:4041 , piece_id=YUXZP4ZV5DVGSZHZWJLDXO3TL2ZJMIOMEEGISAVNKOFBEGOVCNFQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.063932764 (209h24m15.495012895s) [noise=true , address=45.91.116.5:4324 , piece_id=IJJOECQQQ7MY3L6WB5C2IXOBKVRWNZ5P2M3OEHT34KHZTYVWRWCQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.077962448 (209h24m15.509042589s) [noise=true , address=45.91.116.8:4076 , piece_id=C5FLPSO5736OAEDXAYBMLZZCGRKSRKIRO27BIKXEUB3LVPD52WNQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.093100613 (209h24m15.524180734s) [noise=true , address=104.36.82.5:4867 , piece_id=ETNG3H6OSOSPZDVLXYWJXTY2ZHBKZ74PE2VH5YUK4GRJYOWJF54A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.100137808 (209h24m15.531217939s) [noise=true , address=104.36.82.18:4376 , piece_id=L7U3FMBRUQSAKMZA3NETKBH6KHJAZSFW4N35AZLBAIKWAFU7CNPQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.102340693 (209h24m15.533420814s) [noise=true , address=79.127.219.48:4101 , piece_id=Z5GACY3YF4J7POUQHL2HPS2AA2Y7XEOG5WGGBENTCIJTEFZ3D2QQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.109409950 (209h24m15.540490081s) [noise=true , address=79.127.201.215:4354 , piece_id=2VH3UN7BCKYOTGMLD6R3EYK7CUPULXPFAQANDJ5QNM2ZQIDHYNUA, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.123673039 (209h24m15.55475317s) [noise=true , address=77.90.31.13:4659 , piece_id=BOLXO6VDRAFOQVHDWEGPIEWKLLYSBZWMK7YNJHE5L3NSKNTJL25A, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.136900299 (209h24m15.56798043s) [noise=true , address=77.90.31.10:4551 , piece_id=LEWAGNZ2LLALVVTTCXWIAUXA2QCLD5NYYAZTSVMESQAXIL3EXI4Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.150630179 (209h24m15.58171031s) [noise=true , address=104.36.82.60:4369 , piece_id=KXO5CT43T6RVXHJPHDKXYHG4WN3FV4EKK56VCDWYITKA7E6HSW2Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.189487789 (209h24m15.62056791s) [noise=true , address=45.91.116.12:4255 , piece_id=F7LW2XA3YGTBZEG5IZ3LHPXA5IMPGVTY7XJR6FNMWGZSNKUPTQ5Q, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216867497 (209h24m15.647947628s) [noise=true , address=77.90.31.18:4810 , piece_id=RSP7ENPIWJVEWWWEETDJ27AJM3JETBPWTZ2GWBDIQ2VBWOS4F5JQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: <nil>
Aug 17 10:50:21.216895170 (209h24m15.647975301s) [seg_pos={0 0}, upload=217794]: Segment reached optimal threshold of 14 pieces.
Aug 17 10:50:21.217005331 (209h24m15.648085462s) [noise=true , address=45.91.116.4:4954 , piece_id=HDUOPDCSITTEJGPIJS7BPSRHPRYPGEDVLLQXLERLLATYZ7VI2ZBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tT1yhzA7AUuwesNf62NHyVxgSvbrmFzchYSmYdqihRjuAgvYa): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217061869 (209h24m15.648142s) [noise=true , address=104.36.82.44:4887 , piece_id=MJ2VTI3W3F74APBRYZTL75XUQ4OWZESAXKY4BW4QZ72TH3CEOMBQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217173573 (209h24m15.648253704s) [noise=true , address=45.91.116.10:4111 , piece_id=SYNOLWOAG6DIQLY3WUKK2MNQWTOMNDZEH4CZJOOZZKUZ5CB426FQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GwdSAzp9mVGZWsUmpwBD9WVLGrbv6p3ZnG2jvxAf49qC4eeeG): protocol: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40616->45.91.116.10:4111: use of closed network connection
Aug 17 10:50:21.217234689 (209h24m15.64831481s) [noise=true , address=77.90.31.16:4767 , piece_id=OLGNPZP7HUANOE6BSQ5TU3EIOQ2CH5ECTCKKH7BAS6WHUJ352EMQ, seg_pos={0 0}, upload=217794]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK): protocol: expected piece hash; context canceled; EOF
Aug 17 10:50:21.217270257 (209h24m15.648350378s) [seg_pos={0 0}, upload=217794]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 10:50:21.217345601 (209h24m15.648425732s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 10:50:21.217349930 (209h24m15.648430061s) [upload=217794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 10:50:21.559461270 (209h24m15.990541401s) [upload=217794]: Done uploading segments...
Aug 17 10:50:21.559479955 (209h24m15.990560086s) [upload=217794]: Upload finished. err: <nil>
Duration: 3.922398588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.......XXX.............................................] duration:
1.836513333s
FAIL (2025-08-17 10:50:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.83655295s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......XXX............................................] duration:
1.803004098s
FAIL (2025-08-17 10:49:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.803033124s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.......XXX...........................................] duration:
1.837517814s
FAIL (2025-08-17 10:48:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.83754821s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X......X.......XXX..........................................] duration:
1.929444914s
FAIL (2025-08-17 10:47:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.929477316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X......X.......XXX.........................................] duration:
2.066196882s
FAIL (2025-08-17 10:46:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.066219415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X......X.......XXX........................................] duration:
1.96402053s
FAIL (2025-08-17 10:45:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964044195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..X......X.......XXX.......................................] duration:
1.967773262s
FAIL (2025-08-17 10:44:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.967800303s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..X......X.......XXX......................................] duration:
1.874585113s
FAIL (2025-08-17 10:44:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874612636s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..X......X.......XXX.....................................] duration:
1.912598972s
FAIL (2025-08-17 10:43:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.912617207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..X......X.......XXX....................................] duration:
1.811041813s
FAIL (2025-08-17 10:43:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.811068315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.817969207s
FAIL (2025-08-17 10:43:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.817994666s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.562342964s
FAIL (2025-08-17 10:42:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.5623773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..X......X.......XXX...................................] duration:
1.850278928s
FAIL (2025-08-17 10:42:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.850302463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X......X.......XXX..................................] duration:
1.840940752s
FAIL (2025-08-17 10:42:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840969929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.877992663s
FAIL (2025-08-17 10:41:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.878018834s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..X......X.......XXX.................................] duration:
1.856018211s
FAIL (2025-08-17 10:41:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.856088205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.576635271s
FAIL (2025-08-17 10:40:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.576691246s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..X......X.......XXX................................] duration:
1.899596502s
FAIL (2025-08-17 10:40:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.899621219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..X......X.......XXX...............................] duration:
2.009871742s
FAIL (2025-08-17 10:40:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.009920235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.840408219s
FAIL (2025-08-17 10:40:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.840433238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X..X......X.......XXX..............................] duration:
2.145750119s
FAIL (2025-08-17 10:39:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.14577724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.75794641s
FAIL (2025-08-17 10:39:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.757971038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X..X......X.......XXX.............................] duration:
1.831761621s
FAIL (2025-08-17 10:39:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.831791338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X..X......X.......XXX............................] duration:
1.824756445s
FAIL (2025-08-17 10:38:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 10:16:47.351351638 (208h50m41.782431759s) [upload=217204]: Starting upload Aug 17 10:16:47.351397735 (208h50m41.782477866s) [upload=217204]: Done starting upload Aug 17 10:16:47.351477678 (208h50m41.782557809s) [upload=217204]: Uploading segments... Aug 17 10:16:47.351523807 (208h50m41.782603938s) [upload=217204]: Got next segment. Inline: true Aug 17 10:16:47.351527504 (208h50m41.782607635s) [upload=217204]: Waiting for error group managing segments... Aug 17 10:16:47.351562520 (208h50m41.782642642s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 10:16:47.351566758 (208h50m41.782646889s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 10:16:47.351569465 (208h50m41.782649586s) [upload=217204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 10:16:47.568828528 (208h50m41.999908649s) [upload=217204]: Done uploading segments... Aug 17 10:16:47.568847655 (208h50m41.999927786s) [upload=217204]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824777195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.011832834s
FAIL (2025-08-17 10:38:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 09:59:19.549434772 (208h33m13.980514893s) [upload=216909]: Starting upload Aug 17 09:59:19.549475640 (208h33m13.980555771s) [upload=216909]: Done starting upload Aug 17 09:59:19.549649754 (208h33m13.980729885s) [upload=216909]: Uploading segments... Aug 17 09:59:19.549680162 (208h33m13.980760293s) [upload=216909]: Got next segment. Inline: false Aug 17 09:59:19.549722563 (208h33m13.980802694s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 09:59:19.549727593 (208h33m13.980807724s) [upload=216909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 09:59:19.765592767 (208h33m14.196672898s) [upload=216909]: Next segment err: metaclient: Too Many Requests Aug 17 09:59:19.765608758 (208h33m14.196688889s) [upload=216909]: Done uploading segments... Aug 17 09:59:19.765624919 (208h33m14.19670504s) [upload=216909]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.011866618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|