Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...........X.] duration:
1.896020711s
FAIL (2025-08-18 09:38:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 09:38:23.073478592 (232h12m17.504558723s) [upload=241464]: Starting upload Aug 18 09:38:23.073527977 (232h12m17.504608108s) [upload=241464]: Done starting upload Aug 18 09:38:23.073575206 (232h12m17.504655337s) [upload=241464]: Uploading segments... Aug 18 09:38:23.073649529 (232h12m17.50472966s) [upload=241464]: Got next segment. Inline: true Aug 18 09:38:23.073654258 (232h12m17.504734379s) [upload=241464]: Waiting for error group managing segments... Aug 18 09:38:23.073691069 (232h12m17.5047712s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:38:23.073696068 (232h12m17.504776199s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:38:23.073698974 (232h12m17.504779095s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:38:23.294628635 (232h12m17.725708766s) [upload=241464]: Done uploading segments... Aug 18 09:38:23.294645347 (232h12m17.725725478s) [upload=241464]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896063993s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X................X....................] duration:
5.715281174s
FAIL (2025-08-18 09:38:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.715307162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...........X] duration:
891.318953ms
FAIL (2025-08-18 09:38:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 09:38:23.073478592 (232h12m17.504558723s) [upload=241464]: Starting upload Aug 18 09:38:23.073527977 (232h12m17.504608108s) [upload=241464]: Done starting upload Aug 18 09:38:23.073575206 (232h12m17.504655337s) [upload=241464]: Uploading segments... Aug 18 09:38:23.073649529 (232h12m17.50472966s) [upload=241464]: Got next segment. Inline: true Aug 18 09:38:23.073654258 (232h12m17.504734379s) [upload=241464]: Waiting for error group managing segments... Aug 18 09:38:23.073691069 (232h12m17.5047712s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:38:23.073696068 (232h12m17.504776199s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:38:23.073698974 (232h12m17.504779095s) [upload=241464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:38:23.294628635 (232h12m17.725708766s) [upload=241464]: Done uploading segments... Aug 18 09:38:23.294645347 (232h12m17.725725478s) [upload=241464]: Upload finished. err: metaclient: Too Many Requests
Duration: 891.343701ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X................X...................] duration:
5.712331076s
FAIL (2025-08-18 09:38:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.712353849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
3.972885815s
FAIL (2025-08-18 09:38:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.97291466s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.866735807s
FAIL (2025-08-18 09:37:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 1.866764011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
3.951891548s
FAIL (2025-08-18 09:37:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.951912909s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X................X..................] duration:
6.019629469s
FAIL (2025-08-18 09:37:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 6.019659154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.87847545s
FAIL (2025-08-18 09:36:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 1.878506199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
3.935760892s
FAIL (2025-08-18 09:36:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.935785841s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X................X.................] duration:
5.898456503s
FAIL (2025-08-18 09:35:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.898479225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.26430529s
FAIL (2025-08-18 09:35:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.264342491s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X................X................] duration:
5.816652054s
FAIL (2025-08-18 09:35:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.816678795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.900922359s
FAIL (2025-08-18 09:35:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 1.900959249s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
3.90725753s
FAIL (2025-08-18 09:34:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.907279981s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.927004456s
FAIL (2025-08-18 09:34:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 1.927036718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X................X...............] duration:
5.944113831s
FAIL (2025-08-18 09:34:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.944136545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.512243715s
FAIL (2025-08-18 09:34:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.512269364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
4.045525758s
FAIL (2025-08-18 09:33:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.045556015s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X................X..............] duration:
5.957456608s
FAIL (2025-08-18 09:33:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.957485143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.037294665s
FAIL (2025-08-18 09:33:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.037321255s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.........................................XX.................] duration:
3.920186235s
FAIL (2025-08-18 09:33:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.920211394s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X................X.............] duration:
5.731012881s
FAIL (2025-08-18 09:32:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.731086973s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........................................XX................] duration:
3.936344292s
FAIL (2025-08-18 09:32:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.936372046s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.050788473s
FAIL (2025-08-18 09:31:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.05081775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X................X............] duration:
5.805644192s
FAIL (2025-08-18 09:31:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.805674029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...........................................XX...............] duration:
3.95941754s
FAIL (2025-08-18 09:31:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.959444483s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.036573964s
FAIL (2025-08-18 09:31:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.036599504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [............................................XX..............] duration:
3.901186393s
FAIL (2025-08-18 09:31:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.901210148s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X................X...........] duration:
5.833024199s
FAIL (2025-08-18 09:30:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.833045378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...................X................X..........] duration:
5.949369298s
FAIL (2025-08-18 09:30:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.949396169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............................................XX.............] duration:
4.061568624s
FAIL (2025-08-18 09:30:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.061593883s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.242756523s
FAIL (2025-08-18 09:30:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.242799595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...................X................X.........] duration:
5.675287102s
FAIL (2025-08-18 09:29:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.675308332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..............................................XX............] duration:
3.925369635s
FAIL (2025-08-18 09:29:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.925395656s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.3543479s
FAIL (2025-08-18 09:29:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.354378197s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...............................................XX...........] duration:
3.882590831s
FAIL (2025-08-18 09:28:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.882618654s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...................X................X........] duration:
5.687446141s
FAIL (2025-08-18 09:28:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.687471109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.449075828s
FAIL (2025-08-18 09:28:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 09:28:51.809226265 (232h2m46.240306386s) [upload=241312]: Starting upload Aug 18 09:28:51.809270811 (232h2m46.240350942s) [upload=241312]: Done starting upload Aug 18 09:28:51.809323532 (232h2m46.240403653s) [upload=241312]: Uploading segments... Aug 18 09:28:51.809360051 (232h2m46.240440182s) [upload=241312]: Got next segment. Inline: true Aug 18 09:28:51.809364080 (232h2m46.240444211s) [upload=241312]: Waiting for error group managing segments... Aug 18 09:28:51.809394237 (232h2m46.240474369s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 09:28:51.809398305 (232h2m46.240478436s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 09:28:51.809400720 (232h2m46.240480851s) [upload=241312]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 09:28:53.114133803 (232h2m47.545213934s) [upload=241312]: Done uploading segments... Aug 18 09:28:53.114152068 (232h2m47.545232199s) [upload=241312]: Upload finished. err: <nil>
Duration: 2.449091338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...................X................X.......] duration:
5.642737879s
FAIL (2025-08-18 09:28:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.642764079s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...................X................X......] duration:
5.668382897s
FAIL (2025-08-18 09:27:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.668417312s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [................................................XX..........] duration:
3.906197932s
FAIL (2025-08-18 09:27:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.906222029s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.918335591s
FAIL (2025-08-18 09:27:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 08:39:26.569505557 (231h13m21.000585688s) [upload=240464]: Starting upload
Aug 18 08:39:26.569558017 (231h13m21.000638148s) [upload=240464]: Done starting upload
Aug 18 08:39:26.569636166 (231h13m21.000716297s) [upload=240464]: Uploading segments...
Aug 18 08:39:26.569677014 (231h13m21.000757145s) [upload=240464]: Got next segment. Inline: true
Aug 18 08:39:26.569682755 (231h13m21.000762886s) [upload=240464]: Waiting for error group managing segments...
Aug 18 08:39:26.569725888 (231h13m21.000806019s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 08:39:26.569730697 (231h13m21.000810828s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 08:39:26.569735977 (231h13m21.000816108s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 08:39:26.842416857 (231h13m21.273496988s) [upload=240464]: Done uploading segments...
Aug 18 08:39:26.842434732 (231h13m21.273514863s) [upload=240464]: Upload finished. err: <nil>
Duration: 1.918361771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...................X................X.....] duration:
6.141058923s
FAIL (2025-08-18 09:27:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 6.141087248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.170744436s
FAIL (2025-08-18 09:26:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 08:39:26.569505557 (231h13m21.000585688s) [upload=240464]: Starting upload
Aug 18 08:39:26.569558017 (231h13m21.000638148s) [upload=240464]: Done starting upload
Aug 18 08:39:26.569636166 (231h13m21.000716297s) [upload=240464]: Uploading segments...
Aug 18 08:39:26.569677014 (231h13m21.000757145s) [upload=240464]: Got next segment. Inline: true
Aug 18 08:39:26.569682755 (231h13m21.000762886s) [upload=240464]: Waiting for error group managing segments...
Aug 18 08:39:26.569725888 (231h13m21.000806019s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 08:39:26.569730697 (231h13m21.000810828s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 08:39:26.569735977 (231h13m21.000816108s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 08:39:26.842416857 (231h13m21.273496988s) [upload=240464]: Done uploading segments...
Aug 18 08:39:26.842434732 (231h13m21.273514863s) [upload=240464]: Upload finished. err: <nil>
Duration: 3.170769986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.................................................XX.........] duration:
3.89200356s
FAIL (2025-08-18 09:26:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.892029328s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.079250672s
FAIL (2025-08-18 09:26:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 08:39:26.569505557 (231h13m21.000585688s) [upload=240464]: Starting upload
Aug 18 08:39:26.569558017 (231h13m21.000638148s) [upload=240464]: Done starting upload
Aug 18 08:39:26.569636166 (231h13m21.000716297s) [upload=240464]: Uploading segments...
Aug 18 08:39:26.569677014 (231h13m21.000757145s) [upload=240464]: Got next segment. Inline: true
Aug 18 08:39:26.569682755 (231h13m21.000762886s) [upload=240464]: Waiting for error group managing segments...
Aug 18 08:39:26.569725888 (231h13m21.000806019s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 08:39:26.569730697 (231h13m21.000810828s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 08:39:26.569735977 (231h13m21.000816108s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 08:39:26.842416857 (231h13m21.273496988s) [upload=240464]: Done uploading segments...
Aug 18 08:39:26.842434732 (231h13m21.273514863s) [upload=240464]: Upload finished. err: <nil>
Duration: 2.079276472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................X...................X................X....] duration:
5.689246094s
FAIL (2025-08-18 09:26:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 09:22:30.098389244 (231h56m24.529469426s) [upload=241201]: Starting upload
Aug 18 09:22:30.098484787 (231h56m24.529564918s) [upload=241201]: Done starting upload
Aug 18 09:22:30.098619515 (231h56m24.529699686s) [upload=241201]: Uploading segments...
Aug 18 09:22:30.098975335 (231h56m24.530055497s) [upload=241201]: Got next segment. Inline: false
Aug 18 09:22:30.099068354 (231h56m24.530148525s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 09:22:30.099076219 (231h56m24.53015637s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 09:22:30.570292346 (231h56m25.001372467s) [seg_pos={0 0}, upload=241201]: Begin upload segment...
Aug 18 09:22:30.570335368 (231h56m25.001415489s) [seg_pos={0 0}, upload=241201]: Done begin upload segment.
Aug 18 09:22:30.570361899 (231h56m25.00144203s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570443134 (231h56m25.001523265s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570793364 (231h56m25.001873495s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.570837179 (231h56m25.0019173s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571130479 (231h56m25.00221062s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571146701 (231h56m25.002226832s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571405986 (231h56m25.002486117s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571681293 (231h56m25.002761424s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.571960667 (231h56m25.003040788s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572095495 (231h56m25.003175616s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572243700 (231h56m25.003323831s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572455414 (231h56m25.003535545s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572526240 (231h56m25.003606371s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572783051 (231h56m25.003863182s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.572844870 (231h56m25.003924991s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573015336 (231h56m25.004095467s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573181093 (231h56m25.004261224s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:30.573541633 (231h56m25.004621764s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Uploading piece...
Aug 18 09:22:32.042186542 (231h56m26.473266673s) [upload=241201]: Next returned nil segment
Aug 18 09:22:32.042203575 (231h56m26.473283706s) [upload=241201]: Waiting for error group managing segments...
Aug 18 09:22:32.425658541 (231h56m26.856738672s) [noise=true , address=79.127.220.101:4059 , piece_id=KA4Y3AYVCPML5EER5K7UOPJVFASBVXTVKPEJMBFJEGV5ORK3L5SQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.458997612 (231h56m26.890077743s) [noise=true , address=77.90.31.17:4779 , piece_id=P5KOTYTJNBIITCGZ34WLJ4LZ3RAJRI6Y57JTWYMTJJFO6D2MKKBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.467269198 (231h56m26.898349319s) [noise=true , address=79.127.219.38:4029 , piece_id=ZHXTLX3BRWAYTP5XNDN6NQSBANGV773VNTOT3LS7HES7XLTY6YYQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.470129562 (231h56m26.901209693s) [noise=true , address=77.90.31.11:4582 , piece_id=PAPSH5G6LVAET6ZJENPMMB6AD4TKR7YKVS45R6752L5JHFN2CHKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.497302093 (231h56m26.928382224s) [noise=true , address=79.127.219.48:4103 , piece_id=YS3WUDKIFOWAL5X5I3FSGZLES6SPPB5OKDCG3WVV7UFAEN5KAKQQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.500739580 (231h56m26.931819701s) [noise=true , address=104.36.82.44:4894 , piece_id=4E3FRDGV2TUXZZHL6OEFOEY7BBAPQESCNV3NPLZXSKZFIDED3T4Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.562803723 (231h56m26.993883844s) [noise=true , address=104.36.82.60:4361 , piece_id=JJL5SSQ23FDQC6ABMQROEXRZOX6AB73RRLKXLQEB2CIOHEILE3XQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.565340737 (231h56m26.996420858s) [noise=true , address=104.36.82.23:4480 , piece_id=GPQARXELVLHZFGK6MMCHEGHESWPYSNQHXKA4PSEOOCTQ3WUSGWKQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.568906980 (231h56m26.999987111s) [noise=true , address=79.127.219.51:4216 , piece_id=E6UFKTZGVTCBN42NM3SJ6LJV3ZZ4KNXIWWDII5ZHYFLRFB4LOC6A, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.573195936 (231h56m27.004276067s) [noise=true , address=77.90.31.16:4752 , piece_id=24H3ZKGDUOAE5UAAGQGSJHAXZ2TCBG2SMURKNHXMQOUGCO5TCAVA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.602416778 (231h56m27.033496909s) [noise=true , address=45.91.116.12:4239 , piece_id=FS7F5BCNF5OSV2PUTVPU3ZAEEDSBZ4RTKSKKHB3VH2TOV42C52GA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606848517 (231h56m27.037928648s) [noise=true , address=77.90.31.19:4875 , piece_id=PZHRHO6SWF5BXT6HTXYCWMGP54VI5D6E3B3HEPXLK4O6U6FHHJ5Q, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.606894285 (231h56m27.037974416s) [noise=true , address=77.90.31.10:4526 , piece_id=UTDYCZXSEIVSATBYDQD5OQQK7IMZV2SA3YHRJ3BIDIFH5NIMISSA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636377406 (231h56m27.067457528s) [noise=true , address=45.91.116.12:4232 , piece_id=FXT7ML4ZQWZEJXLLVMRK2V5ZKJL47PJIJOZCT4423D3NILDCUISA, seg_pos={0 0}, upload=241201]: Done uploading piece. err: <nil>
Aug 18 09:22:32.636405320 (231h56m27.067485451s) [seg_pos={0 0}, upload=241201]: Segment reached optimal threshold of 14 pieces.
Aug 18 09:22:32.636636433 (231h56m27.067716564s) [noise=true , address=77.90.31.21:4881 , piece_id=GWT2332ROJJJD3YOOHNWHDIWRQJD56PCHOOUAXBYQLMOMWHWXIRQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W4YnnqptDeH7t6QVMo988zAyAZ3Kj3dFE1yaxjttuWjrMvKeM): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636695706 (231h56m27.067775837s) [noise=true , address=79.127.219.47:4059 , piece_id=2EV4ZTSXSRRPNCUBLD2U2P2YXWU3Q7MQXXZAJEPV5BT632LYVLIQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pX5ugohXha3PzmJ9P5X6qB7Dwtrrwv76r7eeJfSR7GvQF8LMF): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636733338 (231h56m27.067813469s) [noise=true , address=77.90.31.15:4725 , piece_id=25RXPHLURQGSISCMYZVRIM6T4BONO2EX3RNLDFN4LVGUMV3MPFBQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636828460 (231h56m27.067908591s) [noise=true , address=45.91.116.14:4195 , piece_id=GVQ2BP3VN7TXLUD3VK5JFSI2ZMYZASO6MK7Q5B5GNFFGLBNLXBDQ, seg_pos={0 0}, upload=241201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N8gL2cPKtuvwn66hcZWQsoe3KRUYgHoy5FTJ38KZstPzzxiKt): protocol: expected piece hash; context canceled; EOF
Aug 18 09:22:32.636849010 (231h56m27.067929141s) [seg_pos={0 0}, upload=241201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 09:22:32.636927419 (231h56m27.06800754s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 09:22:32.636931828 (231h56m27.068011959s) [upload=241201]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 09:22:32.948912687 (231h56m27.379992818s) [upload=241201]: Done uploading segments...
Aug 18 09:22:32.948930521 (231h56m27.380010642s) [upload=241201]: Upload finished. err: <nil>
Duration: 5.68929075s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.892934078s
FAIL (2025-08-18 09:26:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 08:39:26.569505557 (231h13m21.000585688s) [upload=240464]: Starting upload
Aug 18 08:39:26.569558017 (231h13m21.000638148s) [upload=240464]: Done starting upload
Aug 18 08:39:26.569636166 (231h13m21.000716297s) [upload=240464]: Uploading segments...
Aug 18 08:39:26.569677014 (231h13m21.000757145s) [upload=240464]: Got next segment. Inline: true
Aug 18 08:39:26.569682755 (231h13m21.000762886s) [upload=240464]: Waiting for error group managing segments...
Aug 18 08:39:26.569725888 (231h13m21.000806019s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 08:39:26.569730697 (231h13m21.000810828s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 08:39:26.569735977 (231h13m21.000816108s) [upload=240464]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 08:39:26.842416857 (231h13m21.273496988s) [upload=240464]: Done uploading segments...
Aug 18 08:39:26.842434732 (231h13m21.273514863s) [upload=240464]: Upload finished. err: <nil>
Duration: 1.892962011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..................................................XX........] duration:
3.877152147s
FAIL (2025-08-18 09:25:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
15 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259553095 (231h53m3.690633226s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.259628118 (231h53m3.690708249s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260307247 (231h53m3.691387378s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260520345 (231h53m3.691600476s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260730458 (231h53m3.691810579s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.260933055 (231h53m3.692013186s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262324738 (231h53m3.693404869s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.262782573 (231h53m3.693862704s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.263915662 (231h53m3.694995793s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:09.264835061 (231h53m3.695915192s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Uploading piece...
Aug 18 09:19:10.082348188 (231h53m4.513428309s) [upload=241146]: Next returned nil segment
Aug 18 09:19:10.082364078 (231h53m4.513444209s) [upload=241146]: Waiting for error group managing segments...
Aug 18 09:19:10.452519228 (231h53m4.883599349s) [noise=true , address=81.171.14.70:4045 , piece_id=YJZ2EGT3GU7IDTUQHQWFR772DSGGPQKHJKORS4L6RXJPVOIW4SDA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.461153790 (231h53m4.892233921s) [noise=true , address=81.171.14.70:4042 , piece_id=WAC2WQZAPWZLK5RMKD7F2Q74UG27SCJHXQJ2O7QUEIE6UUFJRFJA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.463977603 (231h53m4.895057734s) [noise=true , address=185.167.204.205:4007 , piece_id=Q6NC5O5MACXXRBXXGIT6QF363DFVHVFV7E4UXJ2B5GLEUWGOG7OA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.465846929 (231h53m4.89692706s) [noise=true , address=81.171.14.70:4031 , piece_id=G377XNKVR7HCDKFNBTM5K4E6B5S3XBAB53BX7N4DVNHSQPHG66NA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488385986 (231h53m4.919466117s) [noise=true , address=81.171.14.70:4033 , piece_id=25FHJBWDC7M4WAFIT4ZFASXAYTWQFR3PODKBCMW3GRQCNJVWE2UQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.488620945 (231h53m4.919701076s) [noise=true , address=81.171.14.70:4032 , piece_id=UXOCOF5MFV7QV2O756CVQPL6J5OTSKA4JMJWAKXJ7ONXQJ2ELEWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.489916043 (231h53m4.920996174s) [noise=true , address=81.171.14.70:4029 , piece_id=YXJEEOARV7RUI4SGCVF6ZLJF6S57EJMBZBPI6AE2ETNA45ML7EAA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.495574449 (231h53m4.92665458s) [noise=true , address=89.149.201.147:4011 , piece_id=EHCFSYL6N3NUARBQPMPQQJQBTHRVNBHJZ67AW54SVEUDDWYSH5UA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.497652876 (231h53m4.928733007s) [noise=true , address=81.171.14.70:4025 , piece_id=MJ2OMBSQ4MMM5OA6IO7U2FQZYOCXLXXBT7LCZHLZ62C7O3SBTZOA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.500466169 (231h53m4.9315463s) [noise=true , address=89.149.201.147:4006 , piece_id=ARKEGU7BP3KMRLASI5PSH32JO34KS5UTKLW5P23PC6Z3ZR2LAYEQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.502469983 (231h53m4.933550114s) [noise=true , address=89.149.201.147:4017 , piece_id=F3V5PFAAXKWDH6DCLKPONDJNIRBMIUOLY62UIDI27UY7URXUXZ6A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.503124095 (231h53m4.934204226s) [noise=true , address=185.167.204.206:4041 , piece_id=IPPLGOKKSH7AMYJXW3EXMT7VEESO2QSSKI3XELEAKH5SCMXGR6TQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.506947370 (231h53m4.938027491s) [noise=true , address=81.171.14.70:4026 , piece_id=W43JZXX5P6AGRL2NP7K2J5VDTVBKJZRQI6SBK2FPH7L22EGPHAYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.508468852 (231h53m4.939548983s) [noise=true , address=89.149.201.147:4003 , piece_id=KJYJQWYO5RX7UOQ53RAS6ISWE3QJW6FYTNKALKU43TWWWIGJNRJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.518880112 (231h53m4.949960243s) [noise=true , address=81.171.14.70:4046 , piece_id=G2E2HONHFVBK2LNXUSGG546XZZP6S42SYTCTGUBEPAVVUINQUEJQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.522570003 (231h53m4.953650124s) [noise=true , address=89.149.201.147:4001 , piece_id=7WYEM6BGQPSL7MIPAKZI4AC7Y4UNWMOIPO25A2KMNGFCUWGHWPAQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.525198342 (231h53m4.956278473s) [noise=true , address=89.149.201.147:4015 , piece_id=M5Z5ZJQHX27LZZVFXIZHXZ4T4BCRHISBOBWC3SCKMWWLCMYWUA7Q, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.529879077 (231h53m4.960959208s) [noise=true , address=89.149.201.147:4007 , piece_id=QZZHTG6I7JPNK3QR4CGQFDJVZA5AGRQKN5QZCODZ3UMP35RGBLWQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541558244 (231h53m4.972638375s) [noise=true , address=89.149.201.147:4020 , piece_id=V6KM6A62SQ7523ZFUTTVRRTFC22NCUAZFXOYSBZXJZMVVHUJ7Q7A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.541816197 (231h53m4.972896328s) [noise=true , address=89.149.201.147:4005 , piece_id=FRQVWP5C3I62TFHIW4BAHK5EV3TTAU42VPL4HJRB56FDOZFMPPYQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.552377155 (231h53m4.983457286s) [noise=true , address=185.167.204.205:4002 , piece_id=D3HVLGV6PN7DQWR464VRQTH5SHLWOR54VM5XJD6EFXEH4ZB2A7LA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.556209488 (231h53m4.987289609s) [noise=true , address=185.167.204.205:4023 , piece_id=6JVYAPKSYRDYN7TAO7ESR3LN5EUIMEYEKRRQYPGYHXZMKMY45FUA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.575707054 (231h53m5.006787185s) [noise=true , address=185.167.204.206:4064 , piece_id=TQEF22LTVG5ZU54UTZHS75MKBUHPNWU7NT45LY5T7J6AFBJFUYMQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:19:10.576606374 (231h53m5.007686505s) [noise=true , address=185.167.204.206:4037 , piece_id=LNELWQXH5V3726VRWYZ7TLFIZOVOSXV3AMJKCCG3RRKVF67RA77A, seg_pos={0 0}, upload=241146]: Done uploading piece. err: <nil>
Aug 18 09:20:08.433919942 (231h54m2.865000073s) [noise=true , address=185.167.204.205:4031 , piece_id=MAGAHWVZ26OKOLFOXD6DZEAKQ5DKRWUONGILOVJALBH67O3QDDLA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1dBpSJ5HRaQRAayr7UmKuY8nDzJeh3MmgmduihjVYJGPUbRvkR, address:185.167.204.205:4031): protocol: write tcp 188.166.225.170:52282->185.167.204.205:4031: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433938117 (231h54m2.865018248s) [noise=true , address=185.167.204.206:4046 , piece_id=VHPNZRHWXCQETX65Z3A3I6Y4MUC3VPFWIKCTRHLTKNJFN7SH3SEA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:1YPnmxhn6aS6pLJ7VhwQkHrefetEQwH3ww3sBRyEghNvhzT8X5, address:185.167.204.206:4046): protocol: write tcp 188.166.225.170:58330->185.167.204.206:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.433999725 (231h54m2.865079856s) [noise=true , address=185.167.204.205:4021 , piece_id=J776OPUXJ725DYI7QGMR3TDIB7SW7JIVZFJIXXOCHTNTW5OPRXQQ, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12FDxcFVTdQeudwXi3bRkqnBSQ7NhjChgqkCZLmEC9T4bxdGA4w, address:185.167.204.205:4021): protocol: write tcp 188.166.225.170:40888->185.167.204.205:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434011879 (231h54m2.86509201s) [noise=true , address=185.167.204.206:4049 , piece_id=B5HHQQODBX6AAVRPORUVK46WL5URFZIK4BLBEMJYZS3T6UYJGZYA, seg_pos={0 0}, upload=241146]: Done uploading piece. err: ecclient: upload failed (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM, address:185.167.204.206:4049): protocol: write tcp 188.166.225.170:54348->185.167.204.206:4049: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 09:20:08.434063898 (231h54m2.865144029s) [seg_pos={0 0}, upload=241146]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Aug 18 09:20:08.604422028 (231h54m3.035502159s) [upload=241146]: Done uploading segments...
Aug 18 09:20:08.604446344 (231h54m3.035526475s) [upload=241146]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.877184449s
core
uplink
eu-select-1
eu1-placement-15
|