Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......................X.........X] duration:
6.094141249s
FAIL (2025-08-22 11:53:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6fe4f6dfa455ad3127ff812228bb9084d31baf24e8dd49d67cb1903d0b4800b8 != before fa5b3a4de7729105d3b83631550e0dcc1d0634da65eb71fc633569ece7d6e870
======LOGS======
Aug 22 11:53:38.890239239 (330h27m33.32131936s) [upload=343816]: Starting upload
Aug 22 11:53:38.890288392 (330h27m33.321368523s) [upload=343816]: Done starting upload
Aug 22 11:53:38.890420645 (330h27m33.321500776s) [upload=343816]: Uploading segments...
Aug 22 11:53:38.890528512 (330h27m33.321608643s) [upload=343816]: Got next segment. Inline: false
Aug 22 11:53:38.890566073 (330h27m33.321646194s) [upload=343816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:53:38.890570733 (330h27m33.321650864s) [upload=343816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:53:39.344716635 (330h27m33.775796766s) [seg_pos={0 0}, upload=343816]: Begin upload segment...
Aug 22 11:53:39.344769516 (330h27m33.775849647s) [seg_pos={0 0}, upload=343816]: Done begin upload segment.
Aug 22 11:53:39.344793081 (330h27m33.775873212s) [noise=true , address=45.91.116.8:4070 , piece_id=7LQ4II4LQN6CNY3XW3FWJ42WRWV3FVNXRMYEZRUG3G2EJ5K3PMJA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.344863216 (330h27m33.775943347s) [noise=true , address=104.36.82.23:4459 , piece_id=CPHCGGJBTKBEHVDRXQSDJHXMS6P46VCCVRGAVUE52I7MBM3VOGSA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345145916 (330h27m33.776226047s) [noise=true , address=45.91.116.11:4142 , piece_id=JBTIW6AOIFQOQRUNPRGVYERA2QETFWDOQ5KI6E74DQFYGF7CINDQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345391216 (330h27m33.776471347s) [noise=true , address=77.90.31.19:4871 , piece_id=KHS6VLPZY5LABJKWFYTKHY54W3X3POWYUMH4IOQIPLQTMKRZDUZA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345405613 (330h27m33.776485744s) [noise=true , address=104.36.82.5:4860 , piece_id=B6OWFZJAJKHOPIGGILOTFSSBFAQMH3WRDEXUC6XOGZNL2MBDHOPA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345670380 (330h27m33.776750511s) [noise=true , address=45.91.116.6:4001 , piece_id=FHMU5R4XT3FZDBRHVFYJRPHKQSD3YZA7PK65TQSOB44CA6XSV63A, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345746756 (330h27m33.776826887s) [noise=true , address=45.91.116.4:4965 , piece_id=QJS5MIAX4ZBEASMHUWC22VQU7JIX4XVXLZBBCVEA562F6UKQLFFQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.345943302 (330h27m33.777023433s) [noise=true , address=104.36.82.12:4152 , piece_id=4BXOCKSBV6IBKP2SKGXLJGXSN7HUX4TMPJNOE72674NBWE4XXL4Q, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346088680 (330h27m33.777168801s) [noise=true , address=104.36.82.60:4340 , piece_id=Z72FIIJN7I5QZOE4PQNG7FDFIFRROFSEBFC4DWJZYC7ZQOMBBYLA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346163053 (330h27m33.777243184s) [noise=true , address=45.91.116.9:4270 , piece_id=XI3SBWQN64WPVXWAD25WZQPMRSEWCF2VAVL375UK6CSTU2JLOIAQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346365299 (330h27m33.77744543s) [noise=true , address=77.90.31.12:4594 , piece_id=V3BVKATLGIMHNORB3HUKO57F3SZIGFWXWXPPAJDZS64R6QI2WXNA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346380408 (330h27m33.77746054s) [noise=true , address=77.90.31.10:4535 , piece_id=UPXALW37SCCF5SVEPB6I3VMTEZFEJAU6O5P2M4CH3STQULFMYJUQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346693497 (330h27m33.777773628s) [noise=true , address=104.36.82.13:4208 , piece_id=27CYMNEYYVISQRC4QHKO5B4OJ6TD2CDO7TMU7CRDKVI6SHJICQBQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346753803 (330h27m33.777833934s) [noise=true , address=79.127.219.51:4202 , piece_id=YWDS5SHGG4LR7SJZKGUJ2VQVBH3MLFURFNBN52BZZVX5FUBR26RQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346983983 (330h27m33.778064114s) [noise=true , address=104.36.82.9:4028 , piece_id=XHZ6GQ2KTY4MLWU7YK5BWLKZNTRBNH5KQWEIZSRCU4FBACGAS7JA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.346998100 (330h27m33.778078231s) [noise=true , address=77.90.31.11:4583 , piece_id=XOMHHIXV4GIYIL5GJQDO56MFFO3A4LXHEEEP7QTKQN742IDPFALA, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.347248039 (330h27m33.77832817s) [noise=true , address=77.90.31.21:4888 , piece_id=VA3V7BU74PB3GEXZNSUCUJVXDD6X65IEFTCJ5VPFWUBO5F22D65A, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:39.347489951 (330h27m33.778570082s) [noise=true , address=77.90.31.18:4814 , piece_id=7RMJUMVNEMSWSK5NIEXICJSZSEQVAGXJJ7NEZEUOFI45GHR5L7KQ, seg_pos={0 0}, upload=343816]: Uploading piece...
Aug 22 11:53:40.852113764 (330h27m35.283193895s) [upload=343816]: Next returned nil segment
Aug 22 11:53:40.852136137 (330h27m35.283216268s) [upload=343816]: Waiting for error group managing segments...
Aug 22 11:53:41.251427341 (330h27m35.682507463s) [noise=true , address=79.127.219.51:4202 , piece_id=YWDS5SHGG4LR7SJZKGUJ2VQVBH3MLFURFNBN52BZZVX5FUBR26RQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.265177001 (330h27m35.696257132s) [noise=true , address=104.36.82.9:4028 , piece_id=XHZ6GQ2KTY4MLWU7YK5BWLKZNTRBNH5KQWEIZSRCU4FBACGAS7JA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.277900354 (330h27m35.708980476s) [noise=true , address=104.36.82.13:4208 , piece_id=27CYMNEYYVISQRC4QHKO5B4OJ6TD2CDO7TMU7CRDKVI6SHJICQBQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.292522522 (330h27m35.723602663s) [noise=true , address=104.36.82.5:4860 , piece_id=B6OWFZJAJKHOPIGGILOTFSSBFAQMH3WRDEXUC6XOGZNL2MBDHOPA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.335537016 (330h27m35.766617147s) [noise=true , address=45.91.116.6:4001 , piece_id=FHMU5R4XT3FZDBRHVFYJRPHKQSD3YZA7PK65TQSOB44CA6XSV63A, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.353157891 (330h27m35.784238022s) [noise=true , address=77.90.31.12:4594 , piece_id=V3BVKATLGIMHNORB3HUKO57F3SZIGFWXWXPPAJDZS64R6QI2WXNA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.369394999 (330h27m35.80047513s) [noise=true , address=77.90.31.21:4888 , piece_id=VA3V7BU74PB3GEXZNSUCUJVXDD6X65IEFTCJ5VPFWUBO5F22D65A, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.377204791 (330h27m35.808284922s) [noise=true , address=45.91.116.9:4270 , piece_id=XI3SBWQN64WPVXWAD25WZQPMRSEWCF2VAVL375UK6CSTU2JLOIAQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.403627449 (330h27m35.83470758s) [noise=true , address=104.36.82.60:4340 , piece_id=Z72FIIJN7I5QZOE4PQNG7FDFIFRROFSEBFC4DWJZYC7ZQOMBBYLA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.440547670 (330h27m35.871627801s) [noise=true , address=45.91.116.11:4142 , piece_id=JBTIW6AOIFQOQRUNPRGVYERA2QETFWDOQ5KI6E74DQFYGF7CINDQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.451959996 (330h27m35.883040128s) [noise=true , address=77.90.31.18:4814 , piece_id=7RMJUMVNEMSWSK5NIEXICJSZSEQVAGXJJ7NEZEUOFI45GHR5L7KQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.454724857 (330h27m35.885804988s) [noise=true , address=104.36.82.12:4152 , piece_id=4BXOCKSBV6IBKP2SKGXLJGXSN7HUX4TMPJNOE72674NBWE4XXL4Q, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.472465922 (330h27m35.903546043s) [noise=true , address=77.90.31.19:4871 , piece_id=KHS6VLPZY5LABJKWFYTKHY54W3X3POWYUMH4IOQIPLQTMKRZDUZA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.472999102 (330h27m35.904079233s) [noise=true , address=104.36.82.23:4459 , piece_id=CPHCGGJBTKBEHVDRXQSDJHXMS6P46VCCVRGAVUE52I7MBM3VOGSA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: <nil>
Aug 22 11:53:41.473009662 (330h27m35.904089783s) [seg_pos={0 0}, upload=343816]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:53:41.473136616 (330h27m35.904216747s) [noise=true , address=77.90.31.10:4535 , piece_id=UPXALW37SCCF5SVEPB6I3VMTEZFEJAU6O5P2M4CH3STQULFMYJUQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 22 11:53:41.473320508 (330h27m35.904400639s) [noise=true , address=77.90.31.11:4583 , piece_id=XOMHHIXV4GIYIL5GJQDO56MFFO3A4LXHEEEP7QTKQN742IDPFALA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 22 11:53:41.473337600 (330h27m35.904417721s) [noise=true , address=45.91.116.4:4965 , piece_id=QJS5MIAX4ZBEASMHUWC22VQU7JIX4XVXLZBBCVEA562F6UKQLFFQ, seg_pos={0 0}, upload=343816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cKuthv2wScEvcdmCxmPiQGGZ5w4tJ5a6tbJdBKt1SJ4e9Cszi): protocol: expected piece hash; context canceled; EOF
Aug 22 11:53:41.473427532 (330h27m35.904507663s) [noise=true , address=45.91.116.8:4070 , piece_id=7LQ4II4LQN6CNY3XW3FWJ42WRWV3FVNXRMYEZRUG3G2EJ5K3PMJA, seg_pos={0 0}, upload=343816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YxZG48z2Q69SDyEKeqUYZCLSw1FF2hMuUzciDYUX5SoyRbnJ9): protocol: expected piece hash; context canceled; EOF
Aug 22 11:53:41.473447510 (330h27m35.904527641s) [seg_pos={0 0}, upload=343816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:53:41.473515952 (330h27m35.904596083s) [upload=343816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:53:41.473521021 (330h27m35.904601162s) [upload=343816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:53:41.900712609 (330h27m36.33179274s) [upload=343816]: Done uploading segments...
Aug 22 11:53:41.900732558 (330h27m36.331812689s) [upload=343816]: Upload finished. err: <nil>
Duration: 6.094170796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration:
6.047368755s
FAIL (2025-08-22 11:53:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 6.047413471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..........................XX.......XX.............X........] duration:
2.164678052s
FAIL (2025-08-22 11:52:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.164702429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X......................X........] duration:
5.809327713s
FAIL (2025-08-22 11:52:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 5.809356637s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration:
5.912422595s
FAIL (2025-08-22 11:51:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 5.912451942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......................X......] duration:
6.092830384s
FAIL (2025-08-22 11:51:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 6.092859017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..........................XX.......XX.............X.......] duration:
2.097249931s
FAIL (2025-08-22 11:51:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.097284677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration:
5.953424559s
FAIL (2025-08-22 11:51:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 5.953458092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..........................XX.......XX.............X......] duration:
1.898147013s
FAIL (2025-08-22 11:50:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.898167781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X......................X....] duration:
6.353789302s
FAIL (2025-08-22 11:50:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 6.353816164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......................X...] duration:
6.061841748s
FAIL (2025-08-22 11:50:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 6.061872178s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..........................XX.......XX.............X.....] duration:
2.130057314s
FAIL (2025-08-22 11:49:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.130098923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......................X..] duration:
5.820157063s
FAIL (2025-08-22 11:49:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 5.82018622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..........................XX.......XX.............X....] duration:
2.008726702s
FAIL (2025-08-22 11:49:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.008743534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......................X.] duration:
6.611080346s
FAIL (2025-08-22 11:48:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 6.611115232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..........................XX.......XX.............X...] duration:
1.935490702s
FAIL (2025-08-22 11:48:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.935511862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
5.963018792s
FAIL (2025-08-22 11:48:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 078d99ffb9533fa3d8e962eb8cfad1463bf00040404e208bb7d67cdda05ecde8 != before fc89f8a70fd8bf11f7ca09d0f7840b2645d1804827726b75471a455cf45e7225
======LOGS======
Aug 22 11:48:12.924190342 (330h22m7.355270503s) [upload=343719]: Starting upload
Aug 22 11:48:12.924323867 (330h22m7.355403998s) [upload=343719]: Done starting upload
Aug 22 11:48:12.924425331 (330h22m7.355505482s) [upload=343719]: Uploading segments...
Aug 22 11:48:12.924583073 (330h22m7.355663204s) [upload=343719]: Got next segment. Inline: false
Aug 22 11:48:12.924640703 (330h22m7.355720854s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:48:12.924646905 (330h22m7.355727037s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:48:13.379869619 (330h22m7.81094975s) [seg_pos={0 0}, upload=343719]: Begin upload segment...
Aug 22 11:48:13.379938432 (330h22m7.811018563s) [seg_pos={0 0}, upload=343719]: Done begin upload segment.
Aug 22 11:48:13.379950334 (330h22m7.811030455s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.379963078 (330h22m7.811043199s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380376219 (330h22m7.81145635s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380390115 (330h22m7.811470236s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.380959605 (330h22m7.812039736s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381398996 (330h22m7.812479127s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381646650 (330h22m7.812726781s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.381885036 (330h22m7.812965197s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382400572 (330h22m7.813480703s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.382602429 (330h22m7.81368256s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383040407 (330h22m7.814120548s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.383758480 (330h22m7.814838612s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384176861 (330h22m7.815256992s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.384823799 (330h22m7.81590393s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385439587 (330h22m7.816519718s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.385859631 (330h22m7.816939762s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386306095 (330h22m7.817386226s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:13.386725598 (330h22m7.817805719s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Uploading piece...
Aug 22 11:48:14.522895158 (330h22m8.953975289s) [upload=343719]: Next returned nil segment
Aug 22 11:48:14.522910066 (330h22m8.953990197s) [upload=343719]: Waiting for error group managing segments...
Aug 22 11:48:14.814458648 (330h22m9.245538779s) [noise=true , address=79.127.205.235:4667 , piece_id=T4FDLALSJKBAZPTKP4IJQFCSZAGD6PZSEIYLQMQATWLCGCURZ3KQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.242831557 (330h22m9.673911688s) [noise=true , address=79.127.220.97:4380 , piece_id=DKOPGQPO34JGOFM6KCCGMDNRDPEOUSJWMV4L36CGUL67LANJ5HPA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.285774073 (330h22m9.716854204s) [noise=true , address=79.127.219.51:4209 , piece_id=6NQWN7ZFFGJBT752JB4IU42753URIOTNTUTUHARAINJWTAOG2KAQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.301538536 (330h22m9.732618667s) [noise=true , address=77.90.31.11:4586 , piece_id=CZCFBQ6W3N3HPQ3EJGC4MPPYDHKRPVKJE3NPI5LWAAXNNUNWWQ6Q, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.303134419 (330h22m9.73421454s) [noise=true , address=104.36.82.44:4875 , piece_id=PPBBMZNXB264OBH5ZM2NDAZNGDYRSQBVN752KYYQJZDMSVVGNLVQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.328210709 (330h22m9.759290841s) [noise=true , address=104.36.82.60:4352 , piece_id=TSOX44OLNBDBHTZU5WMAOKDITYUYADBQM3RFFCIAWLJCXCRVSFDA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.357779286 (330h22m9.788859417s) [noise=true , address=104.36.82.23:4447 , piece_id=H7XR4NCAIT6P35DNUWU3E3ROTHKCZKT5FDKSUTASEGOHVWBOBJJA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.374040459 (330h22m9.80512067s) [noise=true , address=79.127.201.215:4347 , piece_id=CCGTSZB4XOTY3ZB4MUS3TC4VBNTPNLBIW7TDV273SXFSJDJPVFSQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.473241749 (330h22m9.90432187s) [noise=true , address=77.90.31.18:4812 , piece_id=6WMSE2B4L5CT4OITA7FSSLUSR3NKWYPGYOLKKZOJT7NY4RCNYIOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.478876761 (330h22m9.909956892s) [noise=true , address=104.36.82.5:4858 , piece_id=CQGQKCGUT7JTCPCINALC74PRYPVSMPUDRAJUMLEJF54V7TSNKQIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488737919 (330h22m9.91981805s) [noise=true , address=104.36.82.11:4142 , piece_id=V24JRUFQ5OTB5W5ZHJK7PCAIAYTY25NXZQCMYUHY254QKL74OTGQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.488952790 (330h22m9.920032921s) [noise=true , address=77.90.31.12:4611 , piece_id=S7NLHHH3ACIVGFJ4EMXV3TPHYEAMR7MUV4OCHYUKJS64VPLOKNIA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.504071227 (330h22m9.935151358s) [noise=true , address=77.90.31.10:4532 , piece_id=TZL4SVX2MUVZFI45TRXEJ36GC6MLFHXKAMZCH2BIMIMAOFODUWFQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505381694 (330h22m9.936461815s) [noise=true , address=104.36.82.12:4158 , piece_id=UYRAR2XHLFKVMJFYM2IB6ZWKRHAPN5HCVYBW2UA2DJMBYKXEIXOA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: <nil>
Aug 22 11:48:15.505393808 (330h22m9.936473939s) [seg_pos={0 0}, upload=343719]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:48:15.505508457 (330h22m9.936588578s) [noise=true , address=104.36.82.9:4022 , piece_id=2KVTLCFPEQ6VI7PW6MIGFG2K6NGOPYPB4HXHEXBR6T76XSRCNXNQ, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505612136 (330h22m9.936692267s) [noise=true , address=77.90.31.21:4890 , piece_id=Y6NQOK3PTY6556VQYFG5U6VDUBXSD5ZINLRPBBOPHVGFBNKAMYKA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 22 11:48:15.505711305 (330h22m9.936791436s) [noise=true , address=45.91.116.11:4137 , piece_id=QCBKBPXX43EMLQ2KL5XI7AZ2CHTSEDDK7VBP6CZV6PXNAN6EIHMA, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12igGAjxtNvRY5PGicway8phr1fBJe2mwgUkvwqg9PFrsUm95Dv): protocol: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58622->45.91.116.11:4137: use of closed network connection
Aug 22 11:48:15.505819772 (330h22m9.936899904s) [noise=true , address=77.90.31.19:4858 , piece_id=KFOUL65QVGQKBZNWW5CC4CDWC3LSU326RAV2NEZVEGWO5PK6QW3A, seg_pos={0 0}, upload=343719]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c): protocol: read tcp 188.166.225.170:49012->77.90.31.19:4858: use of closed network connection; context canceled
Aug 22 11:48:15.505839681 (330h22m9.936919812s) [seg_pos={0 0}, upload=343719]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:48:15.505914234 (330h22m9.936994365s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:48:15.505918742 (330h22m9.936998863s) [upload=343719]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:48:15.818437148 (330h22m10.249517279s) [upload=343719]: Done uploading segments...
Aug 22 11:48:15.818455903 (330h22m10.249536034s) [upload=343719]: Upload finished. err: <nil>
Duration: 5.963046915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.885658415s
FAIL (2025-08-22 11:47:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.885683094s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..........................XX.......XX.............X..] duration:
1.97457743s
FAIL (2025-08-22 11:47:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.974603741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.86806058s
FAIL (2025-08-22 11:46:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.86808596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..........................XX.......XX.............X.] duration:
1.88417173s
FAIL (2025-08-22 11:46:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.884199742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.995498033s
FAIL (2025-08-22 11:46:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.995525425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..........................XX.......XX.............X] duration:
858.969303ms
FAIL (2025-08-22 11:46:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:46:15.238843508 (330h20m9.669923639s) [upload=343688]: Starting upload Aug 22 11:46:15.238911428 (330h20m9.669991559s) [upload=343688]: Done starting upload Aug 22 11:46:15.238975450 (330h20m9.670055581s) [upload=343688]: Uploading segments... Aug 22 11:46:15.239012101 (330h20m9.670092232s) [upload=343688]: Got next segment. Inline: true Aug 22 11:46:15.239016349 (330h20m9.67009648s) [upload=343688]: Waiting for error group managing segments... Aug 22 11:46:15.239053820 (330h20m9.670133941s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:46:15.239057778 (330h20m9.670137909s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:46:15.239060473 (330h20m9.670140604s) [upload=343688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:46:15.452919015 (330h20m9.883999146s) [upload=343688]: Done uploading segments... Aug 22 11:46:15.452936107 (330h20m9.884016239s) [upload=343688]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.98922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.776412838s
FAIL (2025-08-22 11:45:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.776453936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.87375722s
FAIL (2025-08-22 11:45:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.873782209s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X..........................XX.......XX.............] duration:
1.877006671s
FAIL (2025-08-22 11:45:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.877077776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.13623521s
FAIL (2025-08-22 11:44:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 6.136287149s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X..........................XX.......XX............] duration:
1.864754669s
FAIL (2025-08-22 11:44:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.864780648s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.773105616s
FAIL (2025-08-22 11:44:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.773130555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.750874903s
FAIL (2025-08-22 11:43:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.75091505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..........................XX.......XX...........] duration:
1.908377665s
FAIL (2025-08-22 11:43:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.908441758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.88324241s
FAIL (2025-08-22 11:43:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.883281655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X...........X..........................XX.......XX..........] duration:
1.887225164s
FAIL (2025-08-22 11:42:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.887251975s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [XX...........X..........................XX.......XX.........] duration:
2.0021871s
FAIL (2025-08-22 11:42:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.002220183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.966853811s
FAIL (2025-08-22 11:41:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.966879831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.820778157s
FAIL (2025-08-22 11:41:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.820798184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.XX...........X..........................XX.......XX........] duration:
1.892024365s
FAIL (2025-08-22 11:41:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.892043251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.735103937s
FAIL (2025-08-22 11:40:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.735128384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..XX...........X..........................XX.......XX.......] duration:
2.01245204s
FAIL (2025-08-22 11:40:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.012477229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.736195325s
FAIL (2025-08-22 11:40:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.736230251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...XX...........X..........................XX.......XX......] duration:
2.023039526s
FAIL (2025-08-22 11:39:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.023072929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.720288214s
FAIL (2025-08-22 11:39:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.720318743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....XX...........X..........................XX.......XX.....] duration:
1.931944119s
FAIL (2025-08-22 11:38:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931975817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.862004364s
FAIL (2025-08-22 11:38:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.862107822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.748324372s
FAIL (2025-08-22 11:38:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.748354921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [X....XX...........X..........................XX.......XX....] duration:
1.895120375s
FAIL (2025-08-22 11:37:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.895140632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.834896848s
FAIL (2025-08-22 11:37:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.834924401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
8 out of 60 is failed (threshold=3) [.X....XX...........X..........................XX.......XX...] duration:
1.991531696s
FAIL (2025-08-22 11:36:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 11:34:36.779576057 (330h8m31.210656188s) [upload=343490]: Starting upload Aug 22 11:34:36.779623789 (330h8m31.21070392s) [upload=343490]: Done starting upload Aug 22 11:34:36.779671831 (330h8m31.210751952s) [upload=343490]: Uploading segments... Aug 22 11:34:36.779708551 (330h8m31.210788682s) [upload=343490]: Got next segment. Inline: true Aug 22 11:34:36.779712458 (330h8m31.210792589s) [upload=343490]: Waiting for error group managing segments... Aug 22 11:34:36.779743549 (330h8m31.21082367s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 11:34:36.779747436 (330h8m31.210827557s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 11:34:36.779749790 (330h8m31.210829921s) [upload=343490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 11:34:36.994844524 (330h8m31.425924655s) [upload=343490]: Done uploading segments... Aug 22 11:34:36.994861157 (330h8m31.425941288s) [upload=343490]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.991564389s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.02393702s
FAIL (2025-08-22 11:36:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 6.023961888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.851092678s
FAIL (2025-08-22 11:35:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 22 11:32:15.484531281 (330h6m9.915611402s) [upload=343450]: Starting upload
Aug 22 11:32:15.484582369 (330h6m9.91566249s) [upload=343450]: Done starting upload
Aug 22 11:32:15.484714342 (330h6m9.915794473s) [upload=343450]: Uploading segments...
Aug 22 11:32:15.484872283 (330h6m9.915952404s) [upload=343450]: Got next segment. Inline: false
Aug 22 11:32:15.484922980 (330h6m9.916003112s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 11:32:15.484928762 (330h6m9.916008893s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 11:32:16.000927525 (330h6m10.432007677s) [seg_pos={0 0}, upload=343450]: Begin upload segment...
Aug 22 11:32:16.000979325 (330h6m10.432059456s) [seg_pos={0 0}, upload=343450]: Done begin upload segment.
Aug 22 11:32:16.001000075 (330h6m10.432080206s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001485003 (330h6m10.432565134s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001825734 (330h6m10.432905865s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.001951075 (330h6m10.433031206s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002142341 (330h6m10.433222462s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002442585 (330h6m10.433522716s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002478914 (330h6m10.433559045s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.002750043 (330h6m10.433830164s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003015832 (330h6m10.434095963s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003276961 (330h6m10.434357092s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003550154 (330h6m10.434630285s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003823176 (330h6m10.434903307s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.003878272 (330h6m10.434958403s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004148569 (330h6m10.4352287s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004430709 (330h6m10.43551084s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004687310 (330h6m10.435767441s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.004907141 (330h6m10.435987272s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:16.005144695 (330h6m10.436224826s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Uploading piece...
Aug 22 11:32:17.128169388 (330h6m11.559249509s) [upload=343450]: Next returned nil segment
Aug 22 11:32:17.128186761 (330h6m11.559266892s) [upload=343450]: Waiting for error group managing segments...
Aug 22 11:32:17.429727196 (330h6m11.860807327s) [noise=true , address=79.127.205.233:4625 , piece_id=4YS3UWUHSBM2RXTJZTJQGM5GXXFG2JSAMAHGHOVICOATATTHG36Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.909501490 (330h6m12.340581611s) [noise=true , address=77.90.31.18:4809 , piece_id=SUMGLREUZ3KQ7XNBIWO3444QEBOL4ODWH6KU5EZSEMQ4SXCVWB3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.911448014 (330h6m12.342528145s) [noise=true , address=79.127.219.51:4200 , piece_id=OG2PO7LLLTE25GBT5ULTNPNRUXAC7FYXJZHRD6O5AYKNT6NEUPWA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.917046306 (330h6m12.348126447s) [noise=true , address=77.90.31.11:4565 , piece_id=OABSZJVOD5PG3L7YRO56CN2RAZBAI5IH4TF26XHP25IFETT3JAIA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.925158988 (330h6m12.356239119s) [noise=true , address=104.36.82.60:4368 , piece_id=RBIPVNLN6X6M2URKEKICSOHTT2F2QJYRSWVFQ62CKMHLRKO6TCLA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.966782328 (330h6m12.397862459s) [noise=true , address=104.36.82.23:4449 , piece_id=JUO42TVY52HTDO273OQYNPJUBNGAY2T3ASF77ZR2VSTKVVR52IZA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.971931160 (330h6m12.403011291s) [noise=true , address=79.127.219.47:4055 , piece_id=FSMY7FEO3OLRC5HIEZZRS43EP6J2GS65NVSU73Z27XIDSTEL7B3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:17.996590582 (330h6m12.427670713s) [noise=true , address=77.90.31.13:4651 , piece_id=IWIMFFGARP5HLSZANSGCITHLBWFI2NSHCQVJ24M6R27TOLIPODIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.010973111 (330h6m12.442053242s) [noise=true , address=45.91.116.12:4253 , piece_id=ZL6EK7ULBVAYXNZNJXNTSHR52P3ZEARQDC2CCA7T3H52L5P2FJ4A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.043711421 (330h6m12.474791542s) [noise=true , address=77.90.31.15:4701 , piece_id=6Z7OF4643O5LH3W7VUGVHJVIKN4DT5UIP755TC2SKOTA2EQASXZQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.077622376 (330h6m12.508702507s) [noise=true , address=77.90.31.10:4548 , piece_id=7MP3LNS5X7DY6SC74NA45A7Z4656WYPM7IKI3TC66V56WRRXVH4Q, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.137595596 (330h6m12.568675728s) [noise=true , address=104.36.82.15:4290 , piece_id=HCXRBY6Q3UJMECL7U4EFMDA4TEFPMXNREWCTSIVQYK252IVMTNTQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.151567860 (330h6m12.582647991s) [noise=true , address=77.90.31.19:4857 , piece_id=OYAC7RGRPK3MZ6LD3VZMX5NH5JOWIAJE7FQ64QE55QK5D6BDEPPQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202753176 (330h6m12.633833307s) [noise=true , address=104.36.82.5:4844 , piece_id=IOJJYOTV6ZDMKS5XLJKWID52COF6MQUS56WWDSVB22S6NMCA4QHQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: <nil>
Aug 22 11:32:18.202796168 (330h6m12.6338763s) [seg_pos={0 0}, upload=343450]: Segment reached optimal threshold of 14 pieces.
Aug 22 11:32:18.202929564 (330h6m12.634009695s) [noise=true , address=77.90.31.17:4780 , piece_id=343QBQ5MHFXVYMKD3RMXGNP3CU7O3XNBITXLEQHUOZFRZO5WZV3A, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203063701 (330h6m12.634143842s) [noise=true , address=77.90.31.12:4601 , piece_id=554JCP3DBXNJ4WE55BDA2YJW3EI4AOSVMFCI6CZREBSOIGDQPTIQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2): protocol: rpc: dial tcp 77.90.31.12:4601: operation was canceled; conn closed: op
Aug 22 11:32:18.203121641 (330h6m12.634201762s) [noise=true , address=104.36.82.44:4884 , piece_id=B5ICWTRPQLRFNAPJWPJJIXJMEMGUECKSO2QMVZGFNFIBZA2BCSWQ, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59720->104.36.82.44:4884: use of closed network connection
Aug 22 11:32:18.203149485 (330h6m12.634229616s) [noise=true , address=45.91.116.5:4323 , piece_id=J7BV2QRMM5JNNA2ZAEAZAAMEFO64HR7AJAJAT26636EG4NCLUCRA, seg_pos={0 0}, upload=343450]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sNBX9Xaei33rZ1ukq9qUkco2xiEhVSP895V1M1XU3dwYsVsqD): protocol: expected piece hash; context canceled; EOF
Aug 22 11:32:18.203162118 (330h6m12.634242249s) [seg_pos={0 0}, upload=343450]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 11:32:18.203244606 (330h6m12.634324747s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 11:32:18.203250437 (330h6m12.634330578s) [upload=343450]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 11:32:18.523872253 (330h6m12.954952384s) [upload=343450]: Done uploading segments...
Aug 22 11:32:18.523894366 (330h6m12.954974487s) [upload=343450]: Upload finished. err: <nil>
Duration: 5.85111466s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|