Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..X...X.............................] duration:
5.708170578s
FAIL (2025-08-18 03:53:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.708196267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X....X.......X.........X...................X..........X...] duration:
1.862384686s
FAIL (2025-08-18 03:53:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 03:51:56.785217093 (226h25m51.216297224s) [upload=235512]: Starting upload
Aug 18 03:51:56.785266538 (226h25m51.216346669s) [upload=235512]: Done starting upload
Aug 18 03:51:56.785318097 (226h25m51.216398228s) [upload=235512]: Uploading segments...
Aug 18 03:51:56.785358614 (226h25m51.216438745s) [upload=235512]: Got next segment. Inline: true
Aug 18 03:51:56.785362771 (226h25m51.216442902s) [upload=235512]: Waiting for error group managing segments...
Aug 18 03:51:56.785398410 (226h25m51.216478541s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:51:56.785402728 (226h25m51.216482859s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 03:51:56.785405393 (226h25m51.216485524s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:51:57.060559809 (226h25m51.49163994s) [upload=235512]: Done uploading segments...
Aug 18 03:51:57.060576791 (226h25m51.491656912s) [upload=235512]: Upload finished. err: <nil>
Duration: 1.862421106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X..X...X............................] duration:
6.257194806s
FAIL (2025-08-18 03:53:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 6.257215837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X....X.......X.........X...................X..........X..] duration:
2.000428928s
FAIL (2025-08-18 03:52:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 03:51:56.785217093 (226h25m51.216297224s) [upload=235512]: Starting upload
Aug 18 03:51:56.785266538 (226h25m51.216346669s) [upload=235512]: Done starting upload
Aug 18 03:51:56.785318097 (226h25m51.216398228s) [upload=235512]: Uploading segments...
Aug 18 03:51:56.785358614 (226h25m51.216438745s) [upload=235512]: Got next segment. Inline: true
Aug 18 03:51:56.785362771 (226h25m51.216442902s) [upload=235512]: Waiting for error group managing segments...
Aug 18 03:51:56.785398410 (226h25m51.216478541s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:51:56.785402728 (226h25m51.216482859s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 03:51:56.785405393 (226h25m51.216485524s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:51:57.060559809 (226h25m51.49163994s) [upload=235512]: Done uploading segments...
Aug 18 03:51:57.060576791 (226h25m51.491656912s) [upload=235512]: Upload finished. err: <nil>
Duration: 2.000455076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X..X...X...........................] duration:
5.608003292s
FAIL (2025-08-18 03:52:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.60804395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X...X....X.......X.........X...................X..........X.] duration:
1.89322173s
FAIL (2025-08-18 03:52:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 03:51:56.785217093 (226h25m51.216297224s) [upload=235512]: Starting upload
Aug 18 03:51:56.785266538 (226h25m51.216346669s) [upload=235512]: Done starting upload
Aug 18 03:51:56.785318097 (226h25m51.216398228s) [upload=235512]: Uploading segments...
Aug 18 03:51:56.785358614 (226h25m51.216438745s) [upload=235512]: Got next segment. Inline: true
Aug 18 03:51:56.785362771 (226h25m51.216442902s) [upload=235512]: Waiting for error group managing segments...
Aug 18 03:51:56.785398410 (226h25m51.216478541s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:51:56.785402728 (226h25m51.216482859s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 03:51:56.785405393 (226h25m51.216485524s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:51:57.060559809 (226h25m51.49163994s) [upload=235512]: Done uploading segments...
Aug 18 03:51:57.060576791 (226h25m51.491656912s) [upload=235512]: Upload finished. err: <nil>
Duration: 1.893255964s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..X...X..........................] duration:
5.840994031s
FAIL (2025-08-18 03:52:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.841027797s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X...X....X.......X.........X...................X..........X] duration:
1.626656368s
FAIL (2025-08-18 03:51:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 03:51:56.785217093 (226h25m51.216297224s) [upload=235512]: Starting upload
Aug 18 03:51:56.785266538 (226h25m51.216346669s) [upload=235512]: Done starting upload
Aug 18 03:51:56.785318097 (226h25m51.216398228s) [upload=235512]: Uploading segments...
Aug 18 03:51:56.785358614 (226h25m51.216438745s) [upload=235512]: Got next segment. Inline: true
Aug 18 03:51:56.785362771 (226h25m51.216442902s) [upload=235512]: Waiting for error group managing segments...
Aug 18 03:51:56.785398410 (226h25m51.216478541s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:51:56.785402728 (226h25m51.216482859s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 03:51:56.785405393 (226h25m51.216485524s) [upload=235512]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:51:57.060559809 (226h25m51.49163994s) [upload=235512]: Done uploading segments...
Aug 18 03:51:57.060576791 (226h25m51.491656912s) [upload=235512]: Upload finished. err: <nil>
Duration: 1.626680505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..X...X.........................] duration:
5.793548291s
FAIL (2025-08-18 03:51:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.793596394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X...X....X.......X.........X...................X..........] duration:
2.006444878s
FAIL (2025-08-18 03:50:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 2.006467922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X...X....X.......X.........X...................X.........] duration:
1.86964549s
FAIL (2025-08-18 03:50:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.869663594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X..X...X........................] duration:
5.865109408s
FAIL (2025-08-18 03:50:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.865134926s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X...X....X.......X.........X...................X........] duration:
1.866986239s
FAIL (2025-08-18 03:49:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.867029012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X...X....X.......X.........X...................X.......] duration:
2.064025018s
FAIL (2025-08-18 03:49:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 2.064052001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X..X...X.......................] duration:
5.885445829s
FAIL (2025-08-18 03:48:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.885475345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X...X....X.......X.........X...................X......] duration:
1.888743238s
FAIL (2025-08-18 03:48:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.888774718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X...X....X.......X.........X...................X.....] duration:
1.860917025s
FAIL (2025-08-18 03:48:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.86094607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X..X...X......................] duration:
5.783070326s
FAIL (2025-08-18 03:47:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.783098129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X...X....X.......X.........X...................X....] duration:
1.87786275s
FAIL (2025-08-18 03:47:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.877886706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X..X...X.....................] duration:
5.592679591s
FAIL (2025-08-18 03:47:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.592719989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X..X...X....................] duration:
5.989070151s
FAIL (2025-08-18 03:46:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.989099858s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X...X....X.......X.........X...................X...] duration:
1.856532495s
FAIL (2025-08-18 03:46:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.856549059s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X...X....X.......X.........X...................X..] duration:
1.891553727s
FAIL (2025-08-18 03:46:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.891577622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X...X....X.......X.........X...................X.] duration:
1.984627733s
FAIL (2025-08-18 03:45:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 1.984655795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X..X...X...................] duration:
5.784971312s
FAIL (2025-08-18 03:45:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.784995117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X..X...X..................] duration:
5.80972201s
FAIL (2025-08-18 03:45:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.809751035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.496365411s
FAIL (2025-08-18 03:45:15 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.496399205s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X...X....X.......X.........X...................X] duration:
2.09536278s
FAIL (2025-08-18 03:44:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 18 03:44:42.426752534 (226h18m36.857832665s) [upload=235388]: Starting upload Aug 18 03:44:42.426799855 (226h18m36.857879986s) [upload=235388]: Done starting upload Aug 18 03:44:42.426857014 (226h18m36.857937135s) [upload=235388]: Uploading segments... Aug 18 03:44:42.426884737 (226h18m36.857964868s) [upload=235388]: Got next segment. Inline: true Aug 18 03:44:42.426888504 (226h18m36.857968635s) [upload=235388]: Waiting for error group managing segments... Aug 18 03:44:42.426919524 (226h18m36.857999655s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:44:42.426923701 (226h18m36.858003832s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:44:42.426926627 (226h18m36.858006758s) [upload=235388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:44:43.379039935 (226h18m37.810120066s) [upload=235388]: Done uploading segments... Aug 18 03:44:43.379059241 (226h18m37.810139372s) [upload=235388]: Upload finished. err: <nil>
Duration: 2.095384903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..................................X..X...X.................] duration:
6.138913845s
FAIL (2025-08-18 03:44:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 6.138931681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.415097224s
FAIL (2025-08-18 03:44:31 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.41512146s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X...X....X.......X.........X...................] duration:
1.851985718s
FAIL (2025-08-18 03:43:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.852010737s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..................................X..X...X................] duration:
5.918998236s
FAIL (2025-08-18 03:43:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.919026861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.710902003s
FAIL (2025-08-18 03:43:27 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.710922983s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.............X...X....X.......X.........X..................] duration:
2.009067032s
FAIL (2025-08-18 03:43:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.009125805s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.691529317s
FAIL (2025-08-18 03:42:46 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.691550738s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..................................X..X...X...............] duration:
5.796632103s
FAIL (2025-08-18 03:42:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.796659997s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.............X...X....X.......X.........X.................] duration:
2.021483872s
FAIL (2025-08-18 03:42:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.021512798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.545098727s
FAIL (2025-08-18 03:41:54 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.545117142s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.............X...X....X.......X.........X................] duration:
1.839487456s
FAIL (2025-08-18 03:41:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.839514707s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X..X..................................X..X...X..............] duration:
5.635155797s
FAIL (2025-08-18 03:41:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.635179464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.62851364s
FAIL (2025-08-18 03:41:21 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.628621597s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.834680304s
FAIL (2025-08-18 03:40:53 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.834702396s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X..X..................................X..X...X.............] duration:
5.625275846s
FAIL (2025-08-18 03:40:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.625295774s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X.............X...X....X.......X.........X...............] duration:
1.878223709s
FAIL (2025-08-18 03:40:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.878249639s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X.............X...X....X.......X.........X..............] duration:
1.964486974s
FAIL (2025-08-18 03:40:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964518013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.861447864s
FAIL (2025-08-18 03:40:07 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.861473943s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.553699181s
FAIL (2025-08-18 03:39:50 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.55411177s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X..X..................................X..X...X............] duration:
5.839574511s
FAIL (2025-08-18 03:39:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 03:30:46.445163558 (226h4m40.876243689s) [upload=235149]: Starting upload
Aug 18 03:30:46.445209707 (226h4m40.876289888s) [upload=235149]: Done starting upload
Aug 18 03:30:46.445435398 (226h4m40.876515529s) [upload=235149]: Uploading segments...
Aug 18 03:30:46.445466127 (226h4m40.876546258s) [upload=235149]: Got next segment. Inline: false
Aug 18 03:30:46.445497056 (226h4m40.876577187s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 03:30:46.445501464 (226h4m40.876581595s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 03:30:46.905517824 (226h4m41.336597955s) [seg_pos={0 0}, upload=235149]: Begin upload segment...
Aug 18 03:30:46.905576206 (226h4m41.336656337s) [seg_pos={0 0}, upload=235149]: Done begin upload segment.
Aug 18 03:30:46.905601354 (226h4m41.336681485s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.905656530 (226h4m41.336736661s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906070672 (226h4m41.337150803s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906111971 (226h4m41.337192103s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906399732 (226h4m41.337479853s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906412477 (226h4m41.337492608s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906724383 (226h4m41.337804504s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.906793025 (226h4m41.337873156s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907051309 (226h4m41.33813144s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907161369 (226h4m41.3382415s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907436776 (226h4m41.338516907s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907460572 (226h4m41.338540703s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907766527 (226h4m41.338846648s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.907772168 (226h4m41.338852299s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908068655 (226h4m41.339148786s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908082732 (226h4m41.339162864s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908388457 (226h4m41.339468588s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:46.908636301 (226h4m41.339716433s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Uploading piece...
Aug 18 03:30:48.063213451 (226h4m42.494293582s) [upload=235149]: Next returned nil segment
Aug 18 03:30:48.063249441 (226h4m42.494329572s) [upload=235149]: Waiting for error group managing segments...
Aug 18 03:30:48.361036001 (226h4m42.792116142s) [noise=true , address=64.49.13.137:4494 , piece_id=5QHY7C342YXLZZMZS5V5KBPW6IJPF7N46OXKFNO7WMJV5L75D4HQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.792149819 (226h4m43.22322999s) [noise=true , address=77.90.31.19:4868 , piece_id=MJ4HB36MESDNFYWJLJ254N45DQT2MQVS77DVLUTTQT73OCIZNOYQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.794053100 (226h4m43.225133231s) [noise=true , address=45.91.116.11:4145 , piece_id=OPZPJZRLOC32XZCSIACDCG75PHQ3YSBYNYXU5PHC2JIQAFHET6FA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.796834733 (226h4m43.227914864s) [noise=true , address=45.91.116.14:4212 , piece_id=X3IJRIHVYYZLGBXNU4Y53QZUU3LBTXHVP7TVNUIOCT6FVAL2J5SA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813775527 (226h4m43.244855648s) [noise=true , address=104.36.82.19:4418 , piece_id=WVFKVO3WZ3TQWGUDDK766I7WP23WG3CQBJRCVVAM5RDXIMKJW4TA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.813943398 (226h4m43.245023549s) [noise=true , address=77.90.31.11:4582 , piece_id=BUNI3STOG7NJYMLSBQUGRXZ5RIWVKSG43HMV62PYEQVHCEXPBI2A, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.820317685 (226h4m43.251397816s) [noise=true , address=104.36.82.51:4082 , piece_id=LZALDOUXFZVT6PRS3IXWGAOIXO4UENJ2EAYVBI2TWHVQGF6QQXJQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.846803091 (226h4m43.277883212s) [noise=true , address=104.36.82.35:4601 , piece_id=6XWFF36WPPPTXQKTJWAQLOSA2TKGZ56WSORBAOPAVAAGWJEPL5HA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.872659525 (226h4m43.303739656s) [noise=true , address=79.127.201.215:4358 , piece_id=X6IO76OFDTVX5NYHAVTXSTKLMTUDHDM3KNNN53XZGEKCDUORJOZQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.876178828 (226h4m43.307258949s) [noise=true , address=104.36.82.16:4328 , piece_id=I2U72T7HNZJ6BOHA6JAR5C7HZHSRJCLFHUZQNECNOS5OL2NRS5NA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.885351951 (226h4m43.316432082s) [noise=true , address=77.90.31.10:4527 , piece_id=MR3CPFE543DML7DA2KRE3NXCSVKGGTAGV7LCAPUOZMIO7UNPQJEA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.888376407 (226h4m43.319456538s) [noise=true , address=77.90.31.16:4767 , piece_id=RFGIU5UAYK6V3BWVWJKOQJ4S3CJRKBZBPSUVNZHE2QQKUABV2OCA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.889116302 (226h4m43.320196423s) [noise=true , address=104.36.82.8:4975 , piece_id=NLC4LS5UYVJOZ2SNDNST2I3GT5VYCBWWJNYCVBAAWZNYOE6A3V6Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924923285 (226h4m43.356003416s) [noise=true , address=104.36.82.60:4351 , piece_id=CMSKW25HEI6QP43GXCRNRZ3SQ7AMDXVW47CYM63ATBJ7JABORSAQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: <nil>
Aug 18 03:30:48.924948594 (226h4m43.356028725s) [seg_pos={0 0}, upload=235149]: Segment reached optimal threshold of 14 pieces.
Aug 18 03:30:48.925070978 (226h4m43.356151109s) [noise=true , address=104.36.82.59:4309 , piece_id=S65OJVE7DWXS3QLV7CFLUWLO3OSIQUBSWOXSISONG4IMA547SFXA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925131264 (226h4m43.356211395s) [noise=true , address=104.36.82.23:4458 , piece_id=ELTTA6NHAMM7IHM2PFQPASZYY7FVS3RC27GEBGNC5BVYTUDJK47Q, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TMPdLfCbmgi3GqDDg6AUvTCFPzbCCgwTAn9JJBrYJRnbkKtpb): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925162253 (226h4m43.356242384s) [noise=true , address=79.127.201.214:4314 , piece_id=Q6NGNLGP6IRZJQYAVXPVHELDYUCKRW7PGKBTYAWQXNOX55LMJHEQ, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: expected piece hash; context canceled; EOF
Aug 18 03:30:48.925287312 (226h4m43.356367443s) [noise=true , address=77.90.31.13:4660 , piece_id=I5LIHKKO7MHR7J33W2L5MZN776FCLCZT3TOAK4EJM2TA66FRPWOA, seg_pos={0 0}, upload=235149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50046->77.90.31.13:4660: use of closed network connection
Aug 18 03:30:48.925307581 (226h4m43.356387712s) [seg_pos={0 0}, upload=235149]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 03:30:48.925387033 (226h4m43.356467154s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 03:30:48.925391361 (226h4m43.356471492s) [upload=235149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 03:30:49.239942017 (226h4m43.671022148s) [upload=235149]: Done uploading segments...
Aug 18 03:30:49.239960312 (226h4m43.671040443s) [upload=235149]: Upload finished. err: <nil>
Duration: 5.839602353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X.............X...X....X.......X.........X.............] duration:
1.980919534s
FAIL (2025-08-18 03:39:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 03:28:22.625299931 (226h2m17.056380062s) [upload=235113]: Starting upload Aug 18 03:28:22.625346430 (226h2m17.056426561s) [upload=235113]: Done starting upload Aug 18 03:28:22.625399371 (226h2m17.056479502s) [upload=235113]: Uploading segments... Aug 18 03:28:22.625434488 (226h2m17.056514619s) [upload=235113]: Got next segment. Inline: true Aug 18 03:28:22.625438285 (226h2m17.056518416s) [upload=235113]: Waiting for error group managing segments... Aug 18 03:28:22.625488291 (226h2m17.056568422s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 03:28:22.625492549 (226h2m17.05657267s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 03:28:22.625495014 (226h2m17.056575135s) [upload=235113]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 03:28:22.847514783 (226h2m17.278594914s) [upload=235113]: Done uploading segments... Aug 18 03:28:22.847531124 (226h2m17.278611255s) [upload=235113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.980962527s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.542581059s
FAIL (2025-08-18 03:38:58 UTC)
orbiter warning: read tcp 188.166.225.170:47770->136.0.77.2:443: read: connection reset by peer
Duration: 6.542621847s
core
uplink
us-select-1
us1-placement-20
|