Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..............................X.........X...............] duration:
1.892149705s
FAIL (2025-08-17 04:09:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.892213908s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration:
5.60895333s
FAIL (2025-08-17 04:09:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.60897953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration:
5.773589501s
FAIL (2025-08-17 04:08:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.773616593s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.X...................] duration:
6.290738177s
FAIL (2025-08-17 04:08:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 6.290768305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..............................X.........X..............] duration:
1.99052192s
FAIL (2025-08-17 04:08:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.990538622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration:
5.575944568s
FAIL (2025-08-17 04:08:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.575972721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..............................X.........X.............] duration:
2.014399605s
FAIL (2025-08-17 04:07:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.014425817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.X.................] duration:
5.8581097s
FAIL (2025-08-17 04:06:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.85813544s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..............................X.........X............] duration:
1.821796061s
FAIL (2025-08-17 04:06:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.821823944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.X................] duration:
5.676080988s
FAIL (2025-08-17 04:06:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.676104934s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..............................X.........X...........] duration:
1.849161973s
FAIL (2025-08-17 04:05:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.84918718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.X...............] duration:
5.762987966s
FAIL (2025-08-17 04:05:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.763011661s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..............................X.........X..........] duration:
1.814018339s
FAIL (2025-08-17 04:04:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.814049509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.X..............] duration:
5.598271989s
FAIL (2025-08-17 04:04:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.598301056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..............................X.........X.........] duration:
1.83187274s
FAIL (2025-08-17 04:04:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.831896937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.X.............] duration:
5.821436671s
FAIL (2025-08-17 04:03:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.821464464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..............................X.........X........] duration:
1.844972205s
FAIL (2025-08-17 04:03:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844993596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.X............] duration:
5.846762971s
FAIL (2025-08-17 04:02:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.846787328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..............................X.........X.......] duration:
1.871699046s
FAIL (2025-08-17 04:02:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.871735265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.X...........] duration:
5.79077337s
FAIL (2025-08-17 04:01:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.790807125s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..............................X.........X......] duration:
2.340513519s
FAIL (2025-08-17 04:01:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.340534327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.X..........] duration:
6.00799639s
FAIL (2025-08-17 04:00:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 6.008019032s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.X.........] duration:
5.965630138s
FAIL (2025-08-17 04:00:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.965655035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..............................X.........X.....] duration:
1.854897779s
FAIL (2025-08-17 04:00:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854953174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.X........] duration:
5.534219012s
FAIL (2025-08-17 03:59:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.534248259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..............................X.........X....] duration:
1.805410064s
FAIL (2025-08-17 03:59:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.805433019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.X.......] duration:
5.524063024s
FAIL (2025-08-17 03:58:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.524083743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.X......] duration:
5.865149466s
FAIL (2025-08-17 03:58:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.865169595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..............................X.........X...] duration:
1.833667853s
FAIL (2025-08-17 03:58:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833695005s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X.X.....] duration:
5.914780771s
FAIL (2025-08-17 03:57:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.914802191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..............................X.........X..] duration:
1.950165078s
FAIL (2025-08-17 03:57:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.950192609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..............................X.........X.] duration:
1.826269649s
FAIL (2025-08-17 03:57:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826297633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..............................X.........X] duration:
858.595465ms
FAIL (2025-08-17 03:56:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:56:48.655583790 (202h30m43.086663921s) [upload=210657]: Starting upload Aug 17 03:56:48.655627825 (202h30m43.086707956s) [upload=210657]: Done starting upload Aug 17 03:56:48.655720953 (202h30m43.086801084s) [upload=210657]: Uploading segments... Aug 17 03:56:48.655806216 (202h30m43.086886347s) [upload=210657]: Got next segment. Inline: true Aug 17 03:56:48.655811276 (202h30m43.086891407s) [upload=210657]: Waiting for error group managing segments... Aug 17 03:56:48.655854448 (202h30m43.086934579s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:56:48.655859227 (202h30m43.086939358s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:56:48.655861832 (202h30m43.086941963s) [upload=210657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:56:48.869012190 (202h30m43.300092331s) [upload=210657]: Done uploading segments... Aug 17 03:56:48.869031557 (202h30m43.300111708s) [upload=210657]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.619893ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration:
5.523968182s
FAIL (2025-08-17 03:56:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.524001905s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X.X...] duration:
6.058025941s
FAIL (2025-08-17 03:56:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 6.058054647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X..............................X.........] duration:
1.957094864s
FAIL (2025-08-17 03:56:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.957128348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X..............................X........] duration:
1.825300021s
FAIL (2025-08-17 03:55:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.82532596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration:
5.641368773s
FAIL (2025-08-17 03:55:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.641394003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..............................X.......] duration:
1.838266191s
FAIL (2025-08-17 03:54:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838293983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X..............................X......] duration:
2.061861812s
FAIL (2025-08-17 03:54:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.061887981s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................................X.X.] duration:
5.72030315s
FAIL (2025-08-17 03:54:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 5.720350098s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................X.X] duration:
4.143676738s
FAIL (2025-08-17 03:53:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 03:53:41.120239372 (202h27m35.551319503s) [upload=210601]: Starting upload
Aug 17 03:53:41.120292454 (202h27m35.551372585s) [upload=210601]: Done starting upload
Aug 17 03:53:41.120423635 (202h27m35.551503766s) [upload=210601]: Uploading segments...
Aug 17 03:53:41.120516473 (202h27m35.551596604s) [upload=210601]: Got next segment. Inline: false
Aug 17 03:53:41.120564304 (202h27m35.551644435s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:53:41.120569584 (202h27m35.551649715s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:53:41.673681334 (202h27m36.104761465s) [seg_pos={0 0}, upload=210601]: Begin upload segment...
Aug 17 03:53:41.673736750 (202h27m36.104816881s) [seg_pos={0 0}, upload=210601]: Done begin upload segment.
Aug 17 03:53:41.673772859 (202h27m36.10485298s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673780323 (202h27m36.104860444s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.673826572 (202h27m36.104906703s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674177243 (202h27m36.105257374s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674211368 (202h27m36.105291499s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674456257 (202h27m36.105536388s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674562350 (202h27m36.105642471s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.674746032 (202h27m36.105826153s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675025807 (202h27m36.106105938s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675299711 (202h27m36.106379842s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675559598 (202h27m36.106639719s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.675780220 (202h27m36.106860351s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676096786 (202h27m36.107176917s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676144087 (202h27m36.107224218s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676324381 (202h27m36.107404512s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676546737 (202h27m36.107626868s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.676966781 (202h27m36.108046912s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:41.677500682 (202h27m36.108580813s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Uploading piece...
Aug 17 03:53:43.195053069 (202h27m37.6261332s) [upload=210601]: Next returned nil segment
Aug 17 03:53:43.195072387 (202h27m37.626152518s) [upload=210601]: Waiting for error group managing segments...
Aug 17 03:53:43.588715223 (202h27m38.019795354s) [noise=true , address=79.127.219.47:4043 , piece_id=MMOWAFJYWI3NCK3VE7AGIOPSCUWCT5CZPSN7YHTAIMLUVCOUZZKA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.591053828 (202h27m38.022133959s) [noise=true , address=104.36.82.37:4678 , piece_id=VQQVTZYWUMRVYXIW6MDN527MAT7HRGT5M6ILTUONNGWGRU7ZSLQQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.596791586 (202h27m38.027871707s) [noise=true , address=104.36.82.23:4466 , piece_id=CJMUXQS5X3OXAVDJZKLHXATWGN7VEA6IPQUB4VOOTQGVLNKHHH4A, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.615254232 (202h27m38.046334353s) [noise=true , address=45.91.116.13:4187 , piece_id=4JPY7Y57HJQDGJ2NJ7SCOE6O66CA5YZEND6UTC6NMGVTJIG32IPQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.638661248 (202h27m38.069741369s) [noise=true , address=104.36.82.10:4095 , piece_id=ETMBSCHHXVBLAWTLIWJCR5WCAUXP3KJBLZN23CV7AFW7ICEULCLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.658741189 (202h27m38.08982132s) [noise=true , address=104.36.82.59:4324 , piece_id=IJDN76ZXFC36ACG2V4SF3FNSPSN67EEUCILWZJ2WPZLALGNUDPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.659903453 (202h27m38.090983584s) [noise=true , address=104.36.82.35:4605 , piece_id=WNZIRIZWT5CGL22OQE2DA7LOLF7PWIWNW3QSM4UYZGYGRXWIA3JQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.660786282 (202h27m38.091866413s) [noise=true , address=104.36.82.34:4571 , piece_id=FN75NVFRLILCMKPWOKDLSFMCPGHGGPQEK5RB3IUJQSLGNIH4S2LQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.673390127 (202h27m38.104470258s) [noise=true , address=104.36.82.61:4396 , piece_id=AXDZJ22MNGYBZITSNSME64KYFXTBUPPPSN565CVF6GV3NQZFEDZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.689259923 (202h27m38.120340054s) [noise=true , address=104.36.82.20:4471 , piece_id=2KG36E6G7RRCSCY6FF5WRBABTRN3INQD3NGTKTU2KK2CBPLRJNIA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.712182372 (202h27m38.143262503s) [noise=true , address=104.36.82.13:4210 , piece_id=NENXS7EJDA6INQPR7WQHOQ3GR7ER5PV72YG5H37CO5MLQ6CC7DDA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.721830362 (202h27m38.152910493s) [noise=true , address=104.36.82.60:4351 , piece_id=CLBANPM4HGTIGZABFBEW2RD5WVXEUBIAVPE4XBLPRBRDFDEPP5EQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.782495347 (202h27m38.213575478s) [noise=true , address=77.90.31.16:4741 , piece_id=MFXBTQVQMVWBCMW7OMAIY7XENKB7UALEWYT5RJUTT2FHRDJHZ4PA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829370647 (202h27m38.260450778s) [noise=true , address=77.90.31.12:4610 , piece_id=OHER3WVXTFKJEOLQDIC63WGNGDVWWLJ3USVJRXKWRCNF5LVOQ7CQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: <nil>
Aug 17 03:53:43.829400414 (202h27m38.260480545s) [seg_pos={0 0}, upload=210601]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:53:43.829515445 (202h27m38.260595576s) [noise=true , address=77.90.31.18:4809 , piece_id=4CZJHI4DXBZINRAHQRS3SMXHDRT6QAJUAPSRPWKHHAM6P5EGCQUA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829555571 (202h27m38.260635712s) [noise=true , address=45.91.116.10:4115 , piece_id=4UL5NL37XNCSBFV76IK4MW65YMKOOPELCASEDCPYI6TBYMYXVPZA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:53:43.829734493 (202h27m38.260814625s) [noise=true , address=45.91.116.7:4016 , piece_id=LONAAIKKSXAOOG7JEJOULV7DMUOOZ2FSFVFGFKPHSCGU6NJFSVPA, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW): protocol: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41368->45.91.116.7:4016: use of closed network connection
Aug 17 03:53:43.829743541 (202h27m38.260823672s) [noise=true , address=45.91.116.9:4274 , piece_id=235VLHHKIAEP536EJCB6JZNT45L2Y4H6UTL5G3VDM4JT2YQB5GLQ, seg_pos={0 0}, upload=210601]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb): protocol: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37848->45.91.116.9:4274: use of closed network connection
Aug 17 03:53:43.829785470 (202h27m38.260865601s) [seg_pos={0 0}, upload=210601]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:53:43.829902034 (202h27m38.260982165s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:53:43.829907655 (202h27m38.260987786s) [upload=210601]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:53:44.143462131 (202h27m38.574542292s) [upload=210601]: Done uploading segments...
Aug 17 03:53:44.143485336 (202h27m38.574565507s) [upload=210601]: Upload finished. err: <nil>
Duration: 4.143707658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..............................X.....] duration:
1.923974975s
FAIL (2025-08-17 03:53:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.924002037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.517432346s
FAIL (2025-08-17 03:52:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b36469665e14295e674239bb30cc530e92a2b5c8a256c22bb8be7abf007501e7 != before 8eb6c9c4dda466cf50b043d33e74e6b86c0478677f4e8ba618b1fd5d8edaab32
======LOGS======
Aug 17 03:52:03.362743605 (202h25m57.793823726s) [upload=210569]: Starting upload
Aug 17 03:52:03.362796406 (202h25m57.793876537s) [upload=210569]: Done starting upload
Aug 17 03:52:03.362894685 (202h25m57.793974816s) [upload=210569]: Uploading segments...
Aug 17 03:52:03.362986981 (202h25m57.794067112s) [upload=210569]: Got next segment. Inline: false
Aug 17 03:52:03.363030945 (202h25m57.794111086s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:52:03.363039361 (202h25m57.794119502s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:52:03.810941549 (202h25m58.24202173s) [seg_pos={0 0}, upload=210569]: Begin upload segment...
Aug 17 03:52:03.811029418 (202h25m58.242109569s) [seg_pos={0 0}, upload=210569]: Done begin upload segment.
Aug 17 03:52:03.811083692 (202h25m58.242163873s) [noise=true , address=77.90.31.13:4636 , piece_id=56GN3F7HZHKIWK7IG36SJ5NKRDGPWYSKKQLDEUTBIK7BLAKTV5RQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811111034 (202h25m58.242191175s) [noise=true , address=104.36.82.39:4739 , piece_id=KL57UIU6QLU5QES4C7WOAC7BFJTG6YNMJFLOT4K32HKOK6FAB4IA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811167111 (202h25m58.242247242s) [noise=true , address=104.36.82.60:4364 , piece_id=IZGUKFJ3RGYJYIKING4BNI27HDK72APTZRGJQRYUU6AKCUZ3ZIBA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811982761 (202h25m58.243062932s) [noise=true , address=104.36.82.58:4293 , piece_id=5YJ4TKAVMGQQX7POUYTQ7M3TYQ53PTNIGNY77CKISMZ3UHP2CH7A, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812018731 (202h25m58.243098882s) [noise=true , address=45.91.116.9:4294 , piece_id=KY7EUQFICMBMPBTPJPAMLFLU3QSL6W523T3K74RUEWHWIQ4HIS4Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812806477 (202h25m58.243886608s) [noise=true , address=104.36.82.59:4323 , piece_id=26PXJVGEHKOX6DIBIE3PVXG3BGFYOGTOERD5LEPBXLN7EHA5372Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812818571 (202h25m58.243898742s) [noise=true , address=104.36.82.9:4025 , piece_id=S4D6MAW6HBZSKDCIZMB3HT4WBDI3OBNPJQYBQP74KQS5TR7KHPJA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812864970 (202h25m58.243945131s) [noise=true , address=104.36.82.19:4436 , piece_id=J76VYTERTFWLUHKWVN2HG4GMBSAQYWZZV4NKHIWKJHFYLTCCONQA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.813433808 (202h25m58.244513939s) [noise=true , address=45.91.116.13:4177 , piece_id=YHPPHNMVC3XVAEEWXYBS4KU65ZTNGPDLEQ3HI3R43EUELDPK7F4A, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.813471230 (202h25m58.244551361s) [noise=true , address=66.23.193.175:4553 , piece_id=UUF5MXHKXICK4JONTF43E52MGDVKZEJQNMUNU3KDKDCT7AY2IKRA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814021493 (202h25m58.245101634s) [noise=true , address=104.36.82.34:4550 , piece_id=CLFKKZWCDHAFYYC25MVQIR6DQHYN7L5VL2VVESGFTMLIYFZ3QYRQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814069905 (202h25m58.245150047s) [noise=true , address=104.36.82.37:4653 , piece_id=QRGB4OCWYYOVGLB5T3MYF26V2XMZDMFPNT3WFXKMUYT5ODQZH5QQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814551096 (202h25m58.245631237s) [noise=true , address=45.91.116.10:4115 , piece_id=KFQFCBD55NIYLRY43JTPEVBVFNK5YJ6IBFKAKYQ3LD6DFHNPANXA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814593457 (202h25m58.245673588s) [noise=true , address=104.36.82.35:4598 , piece_id=X3Y2QZKZUWKOPKKSF54SXLRUOGSWPG26RLJ6MTADBAMXVYPOGATA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814975759 (202h25m58.2460559s) [noise=true , address=77.90.31.19:4876 , piece_id=G5KGJSCQEFJBITYNANGVWU5MHCMEMDBYSUBLMNR7ATDHSMIC5DHA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815037527 (202h25m58.246117658s) [noise=true , address=104.36.82.38:4695 , piece_id=ZXQMJ7LSCTJ5FNQD7ODFEWUMSC745RR43UJIV75YHTZ4A4WSERXQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815391534 (202h25m58.246471675s) [noise=true , address=104.36.82.23:4470 , piece_id=L4HD55MMYKNKJ7TL4WEJBENUARIB5BLNX54MSUTR3HGPEJZZQYGQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815747445 (202h25m58.246827576s) [noise=true , address=104.36.82.51:4053 , piece_id=PKPD22CWL4IX3QOMIFLQBUGT7UPPRTWEPDTKTNSATMY6IVE64Q3Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:04.938141185 (202h25m59.369221306s) [upload=210569]: Next returned nil segment
Aug 17 03:52:04.938155482 (202h25m59.369235613s) [upload=210569]: Waiting for error group managing segments...
Aug 17 03:52:05.239597724 (202h25m59.670677855s) [noise=true , address=66.23.193.175:4553 , piece_id=UUF5MXHKXICK4JONTF43E52MGDVKZEJQNMUNU3KDKDCT7AY2IKRA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.723798311 (202h26m0.154878442s) [noise=true , address=104.36.82.23:4470 , piece_id=L4HD55MMYKNKJ7TL4WEJBENUARIB5BLNX54MSUTR3HGPEJZZQYGQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.738514589 (202h26m0.16959471s) [noise=true , address=104.36.82.37:4653 , piece_id=QRGB4OCWYYOVGLB5T3MYF26V2XMZDMFPNT3WFXKMUYT5ODQZH5QQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.741392465 (202h26m0.172472596s) [noise=true , address=104.36.82.35:4598 , piece_id=X3Y2QZKZUWKOPKKSF54SXLRUOGSWPG26RLJ6MTADBAMXVYPOGATA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.790099750 (202h26m0.221179882s) [noise=true , address=104.36.82.58:4293 , piece_id=5YJ4TKAVMGQQX7POUYTQ7M3TYQ53PTNIGNY77CKISMZ3UHP2CH7A, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.797953648 (202h26m0.229033779s) [noise=true , address=104.36.82.60:4364 , piece_id=IZGUKFJ3RGYJYIKING4BNI27HDK72APTZRGJQRYUU6AKCUZ3ZIBA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.798096973 (202h26m0.229177104s) [noise=true , address=104.36.82.39:4739 , piece_id=KL57UIU6QLU5QES4C7WOAC7BFJTG6YNMJFLOT4K32HKOK6FAB4IA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.802397321 (202h26m0.233477452s) [noise=true , address=104.36.82.19:4436 , piece_id=J76VYTERTFWLUHKWVN2HG4GMBSAQYWZZV4NKHIWKJHFYLTCCONQA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.803764246 (202h26m0.234844367s) [noise=true , address=77.90.31.13:4636 , piece_id=56GN3F7HZHKIWK7IG36SJ5NKRDGPWYSKKQLDEUTBIK7BLAKTV5RQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.811156369 (202h26m0.2422365s) [noise=true , address=104.36.82.51:4053 , piece_id=PKPD22CWL4IX3QOMIFLQBUGT7UPPRTWEPDTKTNSATMY6IVE64Q3Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.811632251 (202h26m0.242712372s) [noise=true , address=45.91.116.13:4177 , piece_id=YHPPHNMVC3XVAEEWXYBS4KU65ZTNGPDLEQ3HI3R43EUELDPK7F4A, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.828484535 (202h26m0.259564666s) [noise=true , address=104.36.82.59:4323 , piece_id=26PXJVGEHKOX6DIBIE3PVXG3BGFYOGTOERD5LEPBXLN7EHA5372Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.859258718 (202h26m0.290338839s) [noise=true , address=104.36.82.38:4695 , piece_id=ZXQMJ7LSCTJ5FNQD7ODFEWUMSC745RR43UJIV75YHTZ4A4WSERXQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.869391325 (202h26m0.300471446s) [noise=true , address=104.36.82.34:4550 , piece_id=CLFKKZWCDHAFYYC25MVQIR6DQHYN7L5VL2VVESGFTMLIYFZ3QYRQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.869426623 (202h26m0.300506754s) [seg_pos={0 0}, upload=210569]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:52:05.869543136 (202h26m0.300623267s) [noise=true , address=45.91.116.10:4115 , piece_id=KFQFCBD55NIYLRY43JTPEVBVFNK5YJ6IBFKAKYQ3LD6DFHNPANXA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869587751 (202h26m0.300667882s) [noise=true , address=45.91.116.9:4294 , piece_id=KY7EUQFICMBMPBTPJPAMLFLU3QSL6W523T3K74RUEWHWIQ4HIS4Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d7KuNgPYL5Ca2MPKQQCueQNSsYQifHXMhQ87VEXUhrKpLjuks): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869646704 (202h26m0.300726835s) [noise=true , address=77.90.31.19:4876 , piece_id=G5KGJSCQEFJBITYNANGVWU5MHCMEMDBYSUBLMNR7ATDHSMIC5DHA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869651884 (202h26m0.300732015s) [noise=true , address=104.36.82.9:4025 , piece_id=S4D6MAW6HBZSKDCIZMB3HT4WBDI3OBNPJQYBQP74KQS5TR7KHPJA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244zx11aa7W2RGE7w1qeLfsHLxQ6f8tLJeNcxssa68QywFbX1R): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869679217 (202h26m0.300759348s) [seg_pos={0 0}, upload=210569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:52:05.869787815 (202h26m0.300867946s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:52:05.869793004 (202h26m0.300873135s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:52:06.611757400 (202h26m1.042837541s) [upload=210569]: Done uploading segments...
Aug 17 03:52:06.611776116 (202h26m1.042856248s) [upload=210569]: Upload finished. err: <nil>
Duration: 5.517449979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X..............................X....] duration:
1.950574151s
FAIL (2025-08-17 03:52:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.95059921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
6.184112605s
FAIL (2025-08-17 03:52:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b36469665e14295e674239bb30cc530e92a2b5c8a256c22bb8be7abf007501e7 != before 8eb6c9c4dda466cf50b043d33e74e6b86c0478677f4e8ba618b1fd5d8edaab32
======LOGS======
Aug 17 03:52:03.362743605 (202h25m57.793823726s) [upload=210569]: Starting upload
Aug 17 03:52:03.362796406 (202h25m57.793876537s) [upload=210569]: Done starting upload
Aug 17 03:52:03.362894685 (202h25m57.793974816s) [upload=210569]: Uploading segments...
Aug 17 03:52:03.362986981 (202h25m57.794067112s) [upload=210569]: Got next segment. Inline: false
Aug 17 03:52:03.363030945 (202h25m57.794111086s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:52:03.363039361 (202h25m57.794119502s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:52:03.810941549 (202h25m58.24202173s) [seg_pos={0 0}, upload=210569]: Begin upload segment...
Aug 17 03:52:03.811029418 (202h25m58.242109569s) [seg_pos={0 0}, upload=210569]: Done begin upload segment.
Aug 17 03:52:03.811083692 (202h25m58.242163873s) [noise=true , address=77.90.31.13:4636 , piece_id=56GN3F7HZHKIWK7IG36SJ5NKRDGPWYSKKQLDEUTBIK7BLAKTV5RQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811111034 (202h25m58.242191175s) [noise=true , address=104.36.82.39:4739 , piece_id=KL57UIU6QLU5QES4C7WOAC7BFJTG6YNMJFLOT4K32HKOK6FAB4IA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811167111 (202h25m58.242247242s) [noise=true , address=104.36.82.60:4364 , piece_id=IZGUKFJ3RGYJYIKING4BNI27HDK72APTZRGJQRYUU6AKCUZ3ZIBA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.811982761 (202h25m58.243062932s) [noise=true , address=104.36.82.58:4293 , piece_id=5YJ4TKAVMGQQX7POUYTQ7M3TYQ53PTNIGNY77CKISMZ3UHP2CH7A, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812018731 (202h25m58.243098882s) [noise=true , address=45.91.116.9:4294 , piece_id=KY7EUQFICMBMPBTPJPAMLFLU3QSL6W523T3K74RUEWHWIQ4HIS4Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812806477 (202h25m58.243886608s) [noise=true , address=104.36.82.59:4323 , piece_id=26PXJVGEHKOX6DIBIE3PVXG3BGFYOGTOERD5LEPBXLN7EHA5372Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812818571 (202h25m58.243898742s) [noise=true , address=104.36.82.9:4025 , piece_id=S4D6MAW6HBZSKDCIZMB3HT4WBDI3OBNPJQYBQP74KQS5TR7KHPJA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.812864970 (202h25m58.243945131s) [noise=true , address=104.36.82.19:4436 , piece_id=J76VYTERTFWLUHKWVN2HG4GMBSAQYWZZV4NKHIWKJHFYLTCCONQA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.813433808 (202h25m58.244513939s) [noise=true , address=45.91.116.13:4177 , piece_id=YHPPHNMVC3XVAEEWXYBS4KU65ZTNGPDLEQ3HI3R43EUELDPK7F4A, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.813471230 (202h25m58.244551361s) [noise=true , address=66.23.193.175:4553 , piece_id=UUF5MXHKXICK4JONTF43E52MGDVKZEJQNMUNU3KDKDCT7AY2IKRA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814021493 (202h25m58.245101634s) [noise=true , address=104.36.82.34:4550 , piece_id=CLFKKZWCDHAFYYC25MVQIR6DQHYN7L5VL2VVESGFTMLIYFZ3QYRQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814069905 (202h25m58.245150047s) [noise=true , address=104.36.82.37:4653 , piece_id=QRGB4OCWYYOVGLB5T3MYF26V2XMZDMFPNT3WFXKMUYT5ODQZH5QQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814551096 (202h25m58.245631237s) [noise=true , address=45.91.116.10:4115 , piece_id=KFQFCBD55NIYLRY43JTPEVBVFNK5YJ6IBFKAKYQ3LD6DFHNPANXA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814593457 (202h25m58.245673588s) [noise=true , address=104.36.82.35:4598 , piece_id=X3Y2QZKZUWKOPKKSF54SXLRUOGSWPG26RLJ6MTADBAMXVYPOGATA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.814975759 (202h25m58.2460559s) [noise=true , address=77.90.31.19:4876 , piece_id=G5KGJSCQEFJBITYNANGVWU5MHCMEMDBYSUBLMNR7ATDHSMIC5DHA, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815037527 (202h25m58.246117658s) [noise=true , address=104.36.82.38:4695 , piece_id=ZXQMJ7LSCTJ5FNQD7ODFEWUMSC745RR43UJIV75YHTZ4A4WSERXQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815391534 (202h25m58.246471675s) [noise=true , address=104.36.82.23:4470 , piece_id=L4HD55MMYKNKJ7TL4WEJBENUARIB5BLNX54MSUTR3HGPEJZZQYGQ, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:03.815747445 (202h25m58.246827576s) [noise=true , address=104.36.82.51:4053 , piece_id=PKPD22CWL4IX3QOMIFLQBUGT7UPPRTWEPDTKTNSATMY6IVE64Q3Q, seg_pos={0 0}, upload=210569]: Uploading piece...
Aug 17 03:52:04.938141185 (202h25m59.369221306s) [upload=210569]: Next returned nil segment
Aug 17 03:52:04.938155482 (202h25m59.369235613s) [upload=210569]: Waiting for error group managing segments...
Aug 17 03:52:05.239597724 (202h25m59.670677855s) [noise=true , address=66.23.193.175:4553 , piece_id=UUF5MXHKXICK4JONTF43E52MGDVKZEJQNMUNU3KDKDCT7AY2IKRA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.723798311 (202h26m0.154878442s) [noise=true , address=104.36.82.23:4470 , piece_id=L4HD55MMYKNKJ7TL4WEJBENUARIB5BLNX54MSUTR3HGPEJZZQYGQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.738514589 (202h26m0.16959471s) [noise=true , address=104.36.82.37:4653 , piece_id=QRGB4OCWYYOVGLB5T3MYF26V2XMZDMFPNT3WFXKMUYT5ODQZH5QQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.741392465 (202h26m0.172472596s) [noise=true , address=104.36.82.35:4598 , piece_id=X3Y2QZKZUWKOPKKSF54SXLRUOGSWPG26RLJ6MTADBAMXVYPOGATA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.790099750 (202h26m0.221179882s) [noise=true , address=104.36.82.58:4293 , piece_id=5YJ4TKAVMGQQX7POUYTQ7M3TYQ53PTNIGNY77CKISMZ3UHP2CH7A, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.797953648 (202h26m0.229033779s) [noise=true , address=104.36.82.60:4364 , piece_id=IZGUKFJ3RGYJYIKING4BNI27HDK72APTZRGJQRYUU6AKCUZ3ZIBA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.798096973 (202h26m0.229177104s) [noise=true , address=104.36.82.39:4739 , piece_id=KL57UIU6QLU5QES4C7WOAC7BFJTG6YNMJFLOT4K32HKOK6FAB4IA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.802397321 (202h26m0.233477452s) [noise=true , address=104.36.82.19:4436 , piece_id=J76VYTERTFWLUHKWVN2HG4GMBSAQYWZZV4NKHIWKJHFYLTCCONQA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.803764246 (202h26m0.234844367s) [noise=true , address=77.90.31.13:4636 , piece_id=56GN3F7HZHKIWK7IG36SJ5NKRDGPWYSKKQLDEUTBIK7BLAKTV5RQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.811156369 (202h26m0.2422365s) [noise=true , address=104.36.82.51:4053 , piece_id=PKPD22CWL4IX3QOMIFLQBUGT7UPPRTWEPDTKTNSATMY6IVE64Q3Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.811632251 (202h26m0.242712372s) [noise=true , address=45.91.116.13:4177 , piece_id=YHPPHNMVC3XVAEEWXYBS4KU65ZTNGPDLEQ3HI3R43EUELDPK7F4A, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.828484535 (202h26m0.259564666s) [noise=true , address=104.36.82.59:4323 , piece_id=26PXJVGEHKOX6DIBIE3PVXG3BGFYOGTOERD5LEPBXLN7EHA5372Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.859258718 (202h26m0.290338839s) [noise=true , address=104.36.82.38:4695 , piece_id=ZXQMJ7LSCTJ5FNQD7ODFEWUMSC745RR43UJIV75YHTZ4A4WSERXQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.869391325 (202h26m0.300471446s) [noise=true , address=104.36.82.34:4550 , piece_id=CLFKKZWCDHAFYYC25MVQIR6DQHYN7L5VL2VVESGFTMLIYFZ3QYRQ, seg_pos={0 0}, upload=210569]: Done uploading piece. err: <nil>
Aug 17 03:52:05.869426623 (202h26m0.300506754s) [seg_pos={0 0}, upload=210569]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:52:05.869543136 (202h26m0.300623267s) [noise=true , address=45.91.116.10:4115 , piece_id=KFQFCBD55NIYLRY43JTPEVBVFNK5YJ6IBFKAKYQ3LD6DFHNPANXA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1arcuTW5rwnvfiqi2H7dL3oL6jKBkDeGq6DmgRGpS9Vs9BCHmf): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869587751 (202h26m0.300667882s) [noise=true , address=45.91.116.9:4294 , piece_id=KY7EUQFICMBMPBTPJPAMLFLU3QSL6W523T3K74RUEWHWIQ4HIS4Q, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d7KuNgPYL5Ca2MPKQQCueQNSsYQifHXMhQ87VEXUhrKpLjuks): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869646704 (202h26m0.300726835s) [noise=true , address=77.90.31.19:4876 , piece_id=G5KGJSCQEFJBITYNANGVWU5MHCMEMDBYSUBLMNR7ATDHSMIC5DHA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H3UNBGeAufYSdVvEgYkv2QWeFtjKMvHvYGeqGeBvjEHqDDjBB): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869651884 (202h26m0.300732015s) [noise=true , address=104.36.82.9:4025 , piece_id=S4D6MAW6HBZSKDCIZMB3HT4WBDI3OBNPJQYBQP74KQS5TR7KHPJA, seg_pos={0 0}, upload=210569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244zx11aa7W2RGE7w1qeLfsHLxQ6f8tLJeNcxssa68QywFbX1R): protocol: expected piece hash; context canceled; EOF
Aug 17 03:52:05.869679217 (202h26m0.300759348s) [seg_pos={0 0}, upload=210569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:52:05.869787815 (202h26m0.300867946s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:52:05.869793004 (202h26m0.300873135s) [upload=210569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:52:06.611757400 (202h26m1.042837541s) [upload=210569]: Done uploading segments...
Aug 17 03:52:06.611776116 (202h26m1.042856248s) [upload=210569]: Upload finished. err: <nil>
Duration: 6.184138544s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..............................X...] duration:
1.845685456s
FAIL (2025-08-17 03:51:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.845711807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..............................X..] duration:
1.806129152s
FAIL (2025-08-17 03:50:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.806151946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..............................X.] duration:
1.826890856s
FAIL (2025-08-17 03:50:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826943697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X..............................X] duration:
869.907267ms
FAIL (2025-08-17 03:49:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 03:49:25.999748108 (202h23m20.430828239s) [upload=210526]: Starting upload Aug 17 03:49:25.999792723 (202h23m20.430872854s) [upload=210526]: Done starting upload Aug 17 03:49:25.999837399 (202h23m20.43091753s) [upload=210526]: Uploading segments... Aug 17 03:49:25.999869881 (202h23m20.430950012s) [upload=210526]: Got next segment. Inline: true Aug 17 03:49:25.999873558 (202h23m20.430953689s) [upload=210526]: Waiting for error group managing segments... Aug 17 03:49:25.999905128 (202h23m20.430985259s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 03:49:25.999909237 (202h23m20.430989368s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 03:49:25.999911812 (202h23m20.430991943s) [upload=210526]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 03:49:26.223152182 (202h23m20.654232303s) [upload=210526]: Done uploading segments... Aug 17 03:49:26.223170677 (202h23m20.654250808s) [upload=210526]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.928547ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|