Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......X....X.....................X.....X.X..............X.X] duration:
2.260277247s
FAIL (2025-08-13 22:33:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 13 22:33:21.563401179 (125h7m15.99448131s) [upload=130204]: Starting upload Aug 13 22:33:21.563447308 (125h7m15.994527439s) [upload=130204]: Done starting upload Aug 13 22:33:21.563513614 (125h7m15.994593746s) [upload=130204]: Uploading segments... Aug 13 22:33:21.563633835 (125h7m15.994713976s) [upload=130204]: Got next segment. Inline: true Aug 13 22:33:21.563638784 (125h7m15.994718915s) [upload=130204]: Waiting for error group managing segments... Aug 13 22:33:21.563683671 (125h7m15.994763802s) [upload=130204]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:33:21.563688199 (125h7m15.99476832s) [upload=130204]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:33:21.563690764 (125h7m15.994770895s) [upload=130204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:33:22.420434789 (125h7m16.85151492s) [upload=130204]: Done uploading segments... Aug 13 22:33:22.420451099 (125h7m16.85153122s) [upload=130204]: Upload finished. err: <nil>
Duration: 2.260295733s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X....X.....................X.....X.X..............X.] duration:
2.143721356s
FAIL (2025-08-13 22:32:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:32:20.192248765 (125h6m14.623328896s) [upload=130186]: Starting upload Aug 13 22:32:20.192290635 (125h6m14.623370766s) [upload=130186]: Done starting upload Aug 13 22:32:20.192347795 (125h6m14.623427926s) [upload=130186]: Uploading segments... Aug 13 22:32:20.192392380 (125h6m14.623472511s) [upload=130186]: Got next segment. Inline: true Aug 13 22:32:20.192410524 (125h6m14.623490655s) [upload=130186]: Waiting for error group managing segments... Aug 13 22:32:20.192445862 (125h6m14.623525993s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:32:20.192450401 (125h6m14.623530522s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:32:20.192452806 (125h6m14.623532937s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:32:20.407058376 (125h6m14.838138507s) [upload=130186]: Done uploading segments... Aug 13 22:32:20.407075028 (125h6m14.838155159s) [upload=130186]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.143740643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.X...................X............] duration:
6.382576107s
FAIL (2025-08-13 22:32:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.382603618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X....X.....................X.....X.X..............X] duration:
863.240352ms
FAIL (2025-08-13 22:32:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:32:20.192248765 (125h6m14.623328896s) [upload=130186]: Starting upload Aug 13 22:32:20.192290635 (125h6m14.623370766s) [upload=130186]: Done starting upload Aug 13 22:32:20.192347795 (125h6m14.623427926s) [upload=130186]: Uploading segments... Aug 13 22:32:20.192392380 (125h6m14.623472511s) [upload=130186]: Got next segment. Inline: true Aug 13 22:32:20.192410524 (125h6m14.623490655s) [upload=130186]: Waiting for error group managing segments... Aug 13 22:32:20.192445862 (125h6m14.623525993s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:32:20.192450401 (125h6m14.623530522s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:32:20.192452806 (125h6m14.623532937s) [upload=130186]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:32:20.407058376 (125h6m14.838138507s) [upload=130186]: Done uploading segments... Aug 13 22:32:20.407075028 (125h6m14.838155159s) [upload=130186]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.259961ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X....X.....................X.....X.X..............] duration:
1.89503043s
FAIL (2025-08-13 22:32:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.895061369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.X...................X...........] duration:
8.232443988s
FAIL (2025-08-13 22:31:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 8.232467703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X....X.....................X.....X.X.............] duration:
2.136788259s
FAIL (2025-08-13 22:31:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.13681508s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.X...................X..........] duration:
6.455642281s
FAIL (2025-08-13 22:30:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.455667851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X....X.....................X.....X.X............] duration:
2.05183753s
FAIL (2025-08-13 22:30:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.051865394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X.X...................X.........] duration:
6.306190411s
FAIL (2025-08-13 22:30:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.30621042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.X...................X........] duration:
6.182095248s
FAIL (2025-08-13 22:29:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.182127058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X............X....X.....................X.....X.X...........] duration:
1.881340874s
FAIL (2025-08-13 22:29:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.881366273s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X............X....X.....................X.....X.X..........] duration:
1.880470772s
FAIL (2025-08-13 22:28:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.880497903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.X...................X.......] duration:
5.938085145s
FAIL (2025-08-13 22:28:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 5.938113658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X............X....X.....................X.....X.X.........] duration:
1.896280811s
FAIL (2025-08-13 22:28:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.89631162s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.X...................X......] duration:
5.982925206s
FAIL (2025-08-13 22:28:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 5.982949153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...............................X.X...................X.....] duration:
6.33484216s
FAIL (2025-08-13 22:27:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.334865004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X............X....X.....................X.....X.X........] duration:
2.306550848s
FAIL (2025-08-13 22:27:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.306578562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...............................X.X...................X....] duration:
6.55079335s
FAIL (2025-08-13 22:26:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.550812826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X............X....X.....................X.....X.X.......] duration:
1.976562656s
FAIL (2025-08-13 22:26:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.97659058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...............................X.X...................X...] duration:
6.132132883s
FAIL (2025-08-13 22:25:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.132153392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X............X....X.....................X.....X.X......] duration:
1.925947793s
FAIL (2025-08-13 22:25:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.925979214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...............................X.X...................X..] duration:
6.031473363s
FAIL (2025-08-13 22:25:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.03151379s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X............X....X.....................X.....X.X.....] duration:
1.90927366s
FAIL (2025-08-13 22:24:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.909303756s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...............................X.X...................X.] duration:
6.066701741s
FAIL (2025-08-13 22:24:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 6.066728903s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X............X....X.....................X.....X.X....] duration:
1.840470307s
FAIL (2025-08-13 22:24:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840501447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X.......X............X....X.....................X.....X.X...] duration:
2.086418666s
FAIL (2025-08-13 22:23:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.086450217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...............................X.X...................X] duration:
4.220321616s
FAIL (2025-08-13 22:23:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 22:23:27.076683592 (124h57m21.507763773s) [upload=130030]: Starting upload
Aug 13 22:23:27.076777642 (124h57m21.507857783s) [upload=130030]: Done starting upload
Aug 13 22:23:27.076848598 (124h57m21.507928779s) [upload=130030]: Uploading segments...
Aug 13 22:23:27.077253002 (124h57m21.508333133s) [upload=130030]: Got next segment. Inline: false
Aug 13 22:23:27.077296384 (124h57m21.508376535s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:23:27.077304429 (124h57m21.508384631s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:23:27.539037536 (124h57m21.970117667s) [seg_pos={0 0}, upload=130030]: Begin upload segment...
Aug 13 22:23:27.539088183 (124h57m21.970168314s) [seg_pos={0 0}, upload=130030]: Done begin upload segment.
Aug 13 22:23:27.539100357 (124h57m21.970180488s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539106598 (124h57m21.970186729s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539431360 (124h57m21.970511491s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.539683913 (124h57m21.970764044s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.541809920 (124h57m21.972890051s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542030472 (124h57m21.973110603s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542238881 (124h57m21.973319002s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542431851 (124h57m21.973511972s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542631643 (124h57m21.973711774s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542717296 (124h57m21.973797427s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.542973606 (124h57m21.974053737s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543203687 (124h57m21.974283818s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543432485 (124h57m21.974512616s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543521966 (124h57m21.974602087s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543736937 (124h57m21.974817068s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.543929666 (124h57m21.975009797s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544118237 (124h57m21.975198368s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:27.544308822 (124h57m21.975388953s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Uploading piece...
Aug 13 22:23:28.698245373 (124h57m23.129325504s) [upload=130030]: Next returned nil segment
Aug 13 22:23:28.698260061 (124h57m23.129340192s) [upload=130030]: Waiting for error group managing segments...
Aug 13 22:23:29.003091794 (124h57m23.434171925s) [noise=true , address=64.49.13.26:4955 , piece_id=SL5JKO2TTGXNXOLQUT63IOGUXLQDUG4ZGRY3H4KWCHJZIGZ77FVQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.009339849 (124h57m23.44041999s) [noise=true , address=64.49.13.170:4727 , piece_id=RTZNHWVOOXRBN5MMYNTYGMFVSOUIN4J3W3XZTC6IVNLLU27IIBHQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.084068209 (124h57m23.51514836s) [noise=true , address=66.23.193.175:4556 , piece_id=2WOI7MLCETFJDUY7HTFBOKHYXNJ3IXTPWEIZQ6KLROXOVQWYHX2Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.549161996 (124h57m23.980242127s) [noise=true , address=77.90.31.12:4624 , piece_id=LPDCI67F5XQB7SEG67C5KUFNGFKOHT5USEO6HFOD37X43RWXAH6A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.564318396 (124h57m23.995398527s) [noise=true , address=104.36.82.40:4976 , piece_id=YHYYH7JI44UZAY4ZLVZFVUYIJ4K4WMX24UBKEKYFZA7KSWAKP33A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.573779227 (124h57m24.004859358s) [noise=true , address=104.36.82.41:4764 , piece_id=465GIIUBAHTXF3FNSPHBKTOP34KYHSYNN66OPLSBETUGHFL4EXHA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.583540214 (124h57m24.014620355s) [noise=true , address=104.36.82.17:4339 , piece_id=TBMJ5GSNVIWHWQZSBRAB4BXIBUXX7IYIMW77XEMKMQ4MCSAXBT2A, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.589757339 (124h57m24.02083747s) [noise=true , address=104.36.82.37:4654 , piece_id=HZ773PHZLLL65CEQQHQGWIYM5KNH54QKROJENW7Q7ZORL2EYNCTA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.614391993 (124h57m24.045472124s) [noise=true , address=104.36.82.34:4545 , piece_id=QGXW27JF57M66EMFMOB5VAYTXWX3C3WRUQERWS22WHUOBC2IMQEQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.623167523 (124h57m24.054247654s) [noise=true , address=104.36.82.39:4758 , piece_id=44RZTV2WL22GTYGON2NDZC53GEESKGRYBMRC5M4KXIOUQHKXYA4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.628347866 (124h57m24.059427997s) [noise=true , address=104.36.82.13:4195 , piece_id=6O5RJSCAGCUT2RLMQG7UOOTWWULM2EZ4BDYV7J7FW573KALXX4YA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.651984951 (124h57m24.083065082s) [noise=true , address=104.36.82.12:4176 , piece_id=NFUC2B4XU2B3I2T36BP7HK5LNRP73V3YMZAHOJE2I3NR3FXZQ4RA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.750796249 (124h57m24.18187642s) [noise=true , address=104.36.82.45:4919 , piece_id=XBMBX6RVBUWQA2N2D4QAQAIUQJ5V4UI25B3KSGZSUZNBN6KA7P4Q, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862413850 (124h57m24.293493991s) [noise=true , address=104.36.82.44:4878 , piece_id=O2MM7O2PQCQDQU455AOCO2GYYP4JWQ3DU7VHQV5O2RYYG5E5NZKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: <nil>
Aug 13 22:23:29.862458727 (124h57m24.293538878s) [seg_pos={0 0}, upload=130030]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:23:29.862747559 (124h57m24.29382771s) [noise=true , address=104.36.82.35:4603 , piece_id=ZWMMV7VTDJSBVNLXA6OHKJRCYTLAI3SEXRTSTLY3PCF5AULWEMKQ, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ASAeTMBu4sY1GuZiSuwTXmhPksA1Te2BVZdcoE9QvpLAmcQX3): protocol: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56100->104.36.82.35:4603: use of closed network connection
Aug 13 22:23:29.862839756 (124h57m24.293919907s) [noise=true , address=104.36.82.4:4816 , piece_id=XQ5X7NVA7ZNWKA7RK2SUD7F7SA3M6KDI7IU5MJU2YV3DVJI2B7GA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mJkBoAJW49vAg52Ts4EgdmC6BoknUngs6ZqC136rGzdSdVLUy): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862930289 (124h57m24.29401044s) [noise=true , address=77.90.31.21:4890 , piece_id=2YHRUKTKZ4ZOELCKJIMVKJ5UY5DN3MZJHK65VGHOCTS4LXH7U5ZA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.862987728 (124h57m24.29406788s) [noise=true , address=104.36.82.19:4414 , piece_id=4VWYCGLYJB24ZX3XZLCHCGJXJLLQN3RYKQMVYU2PPBIIFUDGNQFA, seg_pos={0 0}, upload=130030]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ): protocol: expected piece hash; context canceled; EOF
Aug 13 22:23:29.863002136 (124h57m24.294082288s) [seg_pos={0 0}, upload=130030]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:23:29.863098410 (124h57m24.294178541s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:23:29.863103600 (124h57m24.294183731s) [upload=130030]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:23:30.202727162 (124h57m24.633807323s) [upload=130030]: Done uploading segments...
Aug 13 22:23:30.202781456 (124h57m24.633861587s) [upload=130030]: Upload finished. err: <nil>
Duration: 4.220350261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...............................X.X...................] duration:
6.034823935s
FAIL (2025-08-13 22:23:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.034853531s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X.......X............X....X.....................X.....X.X..] duration:
1.841682407s
FAIL (2025-08-13 22:22:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841707373s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X.......X............X....X.....................X.....X.X.] duration:
2.073551058s
FAIL (2025-08-13 22:22:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.073576206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...............................X.X..................] duration:
6.46647233s
FAIL (2025-08-13 22:22:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.466489102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...............................X.X.................] duration:
6.170102603s
FAIL (2025-08-13 22:21:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.170146629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...............................X.X................] duration:
6.055192456s
FAIL (2025-08-13 22:21:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.055221282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X.......X............X....X.....................X.....X.X] duration:
932.569791ms
FAIL (2025-08-13 22:21:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 22:21:23.365614226 (124h55m17.796694357s) [upload=129992]: Starting upload Aug 13 22:21:23.365663931 (124h55m17.796744062s) [upload=129992]: Done starting upload Aug 13 22:21:23.365734025 (124h55m17.796814156s) [upload=129992]: Uploading segments... Aug 13 22:21:23.365860447 (124h55m17.796940568s) [upload=129992]: Got next segment. Inline: true Aug 13 22:21:23.365865817 (124h55m17.796945938s) [upload=129992]: Waiting for error group managing segments... Aug 13 22:21:23.365908570 (124h55m17.796988701s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:21:23.365913629 (124h55m17.79699376s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:21:23.365916895 (124h55m17.796997026s) [upload=129992]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:21:23.582128168 (124h55m18.013208309s) [upload=129992]: Done uploading segments... Aug 13 22:21:23.582150521 (124h55m18.013230652s) [upload=129992]: Upload finished. err: metaclient: Too Many Requests
Duration: 932.651507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...............................X.X...............] duration:
6.570674661s
FAIL (2025-08-13 22:20:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.570697804s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X.......X............X....X.....................X.....X.] duration:
1.88204812s
FAIL (2025-08-13 22:20:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 22:20:09.579421483 (124h54m4.010501614s) [upload=129972]: Starting upload
Aug 13 22:20:09.579676971 (124h54m4.010757132s) [upload=129972]: Done starting upload
Aug 13 22:20:09.579760852 (124h54m4.010841023s) [upload=129972]: Uploading segments...
Aug 13 22:20:09.579830555 (124h54m4.010910737s) [upload=129972]: Got next segment. Inline: true
Aug 13 22:20:09.579837939 (124h54m4.0109181s) [upload=129972]: Waiting for error group managing segments...
Aug 13 22:20:09.579894778 (124h54m4.010974949s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:20:09.579902784 (124h54m4.010982925s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 22:20:09.579908525 (124h54m4.010988696s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:20:09.868459116 (124h54m4.299539247s) [upload=129972]: Done uploading segments...
Aug 13 22:20:09.868480247 (124h54m4.299560368s) [upload=129972]: Upload finished. err: <nil>
Duration: 1.882092555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...............................X.X..............] duration:
6.423829139s
FAIL (2025-08-13 22:20:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.423867823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X.......X............X....X.....................X.....X] duration:
1.72753579s
FAIL (2025-08-13 22:20:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 22:20:09.579421483 (124h54m4.010501614s) [upload=129972]: Starting upload
Aug 13 22:20:09.579676971 (124h54m4.010757132s) [upload=129972]: Done starting upload
Aug 13 22:20:09.579760852 (124h54m4.010841023s) [upload=129972]: Uploading segments...
Aug 13 22:20:09.579830555 (124h54m4.010910737s) [upload=129972]: Got next segment. Inline: true
Aug 13 22:20:09.579837939 (124h54m4.0109181s) [upload=129972]: Waiting for error group managing segments...
Aug 13 22:20:09.579894778 (124h54m4.010974949s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:20:09.579902784 (124h54m4.010982925s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 22:20:09.579908525 (124h54m4.010988696s) [upload=129972]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:20:09.868459116 (124h54m4.299539247s) [upload=129972]: Done uploading segments...
Aug 13 22:20:09.868480247 (124h54m4.299560368s) [upload=129972]: Upload finished. err: <nil>
Duration: 1.727563584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.......X............X....X.....................X.....] duration:
2.234736617s
FAIL (2025-08-13 22:19:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 22:16:12.290443712 (124h50m6.721523843s) [upload=129904]: Starting upload Aug 13 22:16:12.290493738 (124h50m6.721573869s) [upload=129904]: Done starting upload Aug 13 22:16:12.290542561 (124h50m6.721622692s) [upload=129904]: Uploading segments... Aug 13 22:16:12.290577488 (124h50m6.721657619s) [upload=129904]: Got next segment. Inline: true Aug 13 22:16:12.290581215 (124h50m6.721661346s) [upload=129904]: Waiting for error group managing segments... Aug 13 22:16:12.290612254 (124h50m6.721692385s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:16:12.290616242 (124h50m6.721696373s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:16:12.290618937 (124h50m6.721699068s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:16:12.581790223 (124h50m7.012870354s) [upload=129904]: Done uploading segments... Aug 13 22:16:12.581840780 (124h50m7.012920901s) [upload=129904]: Upload finished. err: <nil>
Duration: 2.234753629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...............................X.X.............] duration:
6.225269764s
FAIL (2025-08-13 22:19:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.225285736s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...............................X.X............] duration:
6.35873904s
FAIL (2025-08-13 22:19:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.358766604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.......X............X....X.....................X....] duration:
2.038597761s
FAIL (2025-08-13 22:19:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 22:16:12.290443712 (124h50m6.721523843s) [upload=129904]: Starting upload Aug 13 22:16:12.290493738 (124h50m6.721573869s) [upload=129904]: Done starting upload Aug 13 22:16:12.290542561 (124h50m6.721622692s) [upload=129904]: Uploading segments... Aug 13 22:16:12.290577488 (124h50m6.721657619s) [upload=129904]: Got next segment. Inline: true Aug 13 22:16:12.290581215 (124h50m6.721661346s) [upload=129904]: Waiting for error group managing segments... Aug 13 22:16:12.290612254 (124h50m6.721692385s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:16:12.290616242 (124h50m6.721696373s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:16:12.290618937 (124h50m6.721699068s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:16:12.581790223 (124h50m7.012870354s) [upload=129904]: Done uploading segments... Aug 13 22:16:12.581840780 (124h50m7.012920901s) [upload=129904]: Upload finished. err: <nil>
Duration: 2.038625213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...............................X.X...........] duration:
6.61664735s
FAIL (2025-08-13 22:18:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.616674253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.......X............X....X.....................X...] duration:
2.259027387s
FAIL (2025-08-13 22:18:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 22:16:12.290443712 (124h50m6.721523843s) [upload=129904]: Starting upload Aug 13 22:16:12.290493738 (124h50m6.721573869s) [upload=129904]: Done starting upload Aug 13 22:16:12.290542561 (124h50m6.721622692s) [upload=129904]: Uploading segments... Aug 13 22:16:12.290577488 (124h50m6.721657619s) [upload=129904]: Got next segment. Inline: true Aug 13 22:16:12.290581215 (124h50m6.721661346s) [upload=129904]: Waiting for error group managing segments... Aug 13 22:16:12.290612254 (124h50m6.721692385s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:16:12.290616242 (124h50m6.721696373s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:16:12.290618937 (124h50m6.721699068s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:16:12.581790223 (124h50m7.012870354s) [upload=129904]: Done uploading segments... Aug 13 22:16:12.581840780 (124h50m7.012920901s) [upload=129904]: Upload finished. err: <nil>
Duration: 2.25905954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...............................X.X..........] duration:
6.789531062s
FAIL (2025-08-13 22:17:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.789557212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.......X............X....X.....................X..] duration:
1.841185758s
FAIL (2025-08-13 22:17:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 22:16:12.290443712 (124h50m6.721523843s) [upload=129904]: Starting upload Aug 13 22:16:12.290493738 (124h50m6.721573869s) [upload=129904]: Done starting upload Aug 13 22:16:12.290542561 (124h50m6.721622692s) [upload=129904]: Uploading segments... Aug 13 22:16:12.290577488 (124h50m6.721657619s) [upload=129904]: Got next segment. Inline: true Aug 13 22:16:12.290581215 (124h50m6.721661346s) [upload=129904]: Waiting for error group managing segments... Aug 13 22:16:12.290612254 (124h50m6.721692385s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:16:12.290616242 (124h50m6.721696373s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:16:12.290618937 (124h50m6.721699068s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:16:12.581790223 (124h50m7.012870354s) [upload=129904]: Done uploading segments... Aug 13 22:16:12.581840780 (124h50m7.012920901s) [upload=129904]: Upload finished. err: <nil>
Duration: 1.841298475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...............X...............................X.X.........] duration:
5.93974649s
FAIL (2025-08-13 22:16:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 5.939772811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.......X............X....X.....................X.] duration:
1.871558341s
FAIL (2025-08-13 22:16:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 22:16:12.290443712 (124h50m6.721523843s) [upload=129904]: Starting upload Aug 13 22:16:12.290493738 (124h50m6.721573869s) [upload=129904]: Done starting upload Aug 13 22:16:12.290542561 (124h50m6.721622692s) [upload=129904]: Uploading segments... Aug 13 22:16:12.290577488 (124h50m6.721657619s) [upload=129904]: Got next segment. Inline: true Aug 13 22:16:12.290581215 (124h50m6.721661346s) [upload=129904]: Waiting for error group managing segments... Aug 13 22:16:12.290612254 (124h50m6.721692385s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 22:16:12.290616242 (124h50m6.721696373s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 22:16:12.290618937 (124h50m6.721699068s) [upload=129904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 22:16:12.581790223 (124h50m7.012870354s) [upload=129904]: Done uploading segments... Aug 13 22:16:12.581840780 (124h50m7.012920901s) [upload=129904]: Upload finished. err: <nil>
Duration: 1.871583349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...............X...............................X.X........] duration:
6.227546694s
FAIL (2025-08-13 22:16:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 22:10:42.319336369 (124h44m36.75041649s) [upload=129816]: Starting upload
Aug 13 22:10:42.319385492 (124h44m36.750465623s) [upload=129816]: Done starting upload
Aug 13 22:10:42.319472870 (124h44m36.750553001s) [upload=129816]: Uploading segments...
Aug 13 22:10:42.319585275 (124h44m36.750665406s) [upload=129816]: Got next segment. Inline: false
Aug 13 22:10:42.319616795 (124h44m36.750696916s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 22:10:42.319621113 (124h44m36.750701244s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 22:10:42.768464087 (124h44m37.199544218s) [seg_pos={0 0}, upload=129816]: Begin upload segment...
Aug 13 22:10:42.768551323 (124h44m37.199631454s) [seg_pos={0 0}, upload=129816]: Done begin upload segment.
Aug 13 22:10:42.768573676 (124h44m37.199653807s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768676313 (124h44m37.199756474s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.768932803 (124h44m37.200012934s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769205796 (124h44m37.200285927s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769223709 (124h44m37.200303841s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769472004 (124h44m37.200552136s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769547088 (124h44m37.200627219s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769751841 (124h44m37.200831962s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.769869465 (124h44m37.200949597s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770003372 (124h44m37.201083503s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770219956 (124h44m37.201300087s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770249172 (124h44m37.201329303s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770477879 (124h44m37.201558s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770530180 (124h44m37.201610311s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770719983 (124h44m37.201800114s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.770819312 (124h44m37.201899443s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771078599 (124h44m37.20215872s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:42.771334989 (124h44m37.20241512s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Uploading piece...
Aug 13 22:10:43.911562023 (124h44m38.342642154s) [upload=129816]: Next returned nil segment
Aug 13 22:10:43.911579367 (124h44m38.342659498s) [upload=129816]: Waiting for error group managing segments...
Aug 13 22:10:44.220958981 (124h44m38.652039112s) [noise=true , address=64.49.13.27:4963 , piece_id=W4OHJHRLPDKK7E7XLOHORZJLZW3WUPMGWYMZCEK2NJBQREYIHSSQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.293485738 (124h44m38.724565879s) [noise=true , address=66.23.193.175:4559 , piece_id=6FRRSWGJRPRTL5QFP6HHMZQIVW55LGMD7CUCQ4YINO7QUXM2AQYQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.668425030 (124h44m39.099505151s) [noise=true , address=79.127.219.51:4182 , piece_id=VUPNYPGYC4PT4YO7PBTL3PZS2KGSUSCDHYXZHG4Z4FCQJ6MWVF2A, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.755442431 (124h44m39.186522563s) [noise=true , address=104.36.82.39:4730 , piece_id=TH72FW2Z67SGMOE5Y7INWJMKEVX3CGUMHRUKXZE5KBX7MSX2NLDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.776435960 (124h44m39.207516131s) [noise=true , address=104.36.82.44:4888 , piece_id=H5QKVOEN5CX2IVIHLKTSK3BTPCZUQLUYNDG7MBIOTG5KZHPVLAHQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.786422557 (124h44m39.217502688s) [noise=true , address=104.36.82.22:4530 , piece_id=JPXEBOUVYEELBQMTDC7ZJS33RIFLTDLBWA4QLXLII364PO62WENQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.791328273 (124h44m39.222408444s) [noise=true , address=104.36.82.35:4616 , piece_id=SQDIEQSDCPWYG2VFKRMD67EJ2YUVUASE2YY6ERZI3ECDS4CY5TKQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.797727867 (124h44m39.228807998s) [noise=true , address=104.36.82.46:4514 , piece_id=RLSKZQX3DK7L4YE2U52WHDYKQY2OFAZZ5PS4P6AYMC5BHU4WTSHA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.802173223 (124h44m39.233253354s) [noise=true , address=104.36.82.49:4987 , piece_id=DNEHJ7IIHLW5NQF2WQFJFY4RQBMZXRP5F5CQ2NYHWGZLYGUN3F3Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.812166193 (124h44m39.243246324s) [noise=true , address=104.36.82.37:4675 , piece_id=HOMAHHJ5X6RGEBGYBEJK2KYK27GUNYFTYM3XJYKONHRAL2ZXPT5Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.819915099 (124h44m39.25099523s) [noise=true , address=104.36.82.43:4864 , piece_id=4YM4JZ2PDFHMQ3BBBOEYMQT7OK4IP55FRHXRAJSTGYR5QAN24SRQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.834487891 (124h44m39.265568022s) [noise=true , address=104.36.82.6:4881 , piece_id=L3PC4QPKAOQDAA363B7PJZVLE3WALLPCF42UQAKEBSPJMVWIAWTQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.852004337 (124h44m39.283084468s) [noise=true , address=104.36.82.44:4902 , piece_id=D7RZEIERCKLLA7O4ZA6G7BFBT6AJAVZHYFVC7RIW7SORB64PAHDA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898765796 (124h44m39.329845927s) [noise=true , address=45.91.116.14:4217 , piece_id=ZGDM5KDJ2UJJ6VOTJ3QKKR2U5VYJCBOSF2WRPIURHS3ABHAYR32Q, seg_pos={0 0}, upload=129816]: Done uploading piece. err: <nil>
Aug 13 22:10:44.898795422 (124h44m39.329875553s) [seg_pos={0 0}, upload=129816]: Segment reached optimal threshold of 14 pieces.
Aug 13 22:10:44.899012678 (124h44m39.330092809s) [noise=true , address=104.36.82.17:4335 , piece_id=UU4VKWBK3BGNYOQFUGAVO6Q7UYX2WRZ4T6F7EN4WIU63YNCTFZIQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899033127 (124h44m39.330113248s) [noise=true , address=104.36.82.61:4404 , piece_id=ZZTNSPXQFNP5DSAWS6LZVPO6RZBUADOEVAZNRLFXQRLZX26WZPMQ, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Py6TMKBL8njtAK5Utj7kkXtVDQbvohnge7osJu8ewbVksodcu): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899078244 (124h44m39.330158375s) [noise=true , address=104.36.82.8:4999 , piece_id=R2BVFYN4LBF7YR6FLOAVIY5CXYY63ZZF2HGEG6NHHGMVHNAO3IXA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899157105 (124h44m39.330237226s) [noise=true , address=77.90.31.17:4775 , piece_id=O6Q7DR4UAOXB3JSSNANOSLFMJLTHINHYWTDN7KA7DPB7RUT5DNKA, seg_pos={0 0}, upload=129816]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127VKvwi82kYfGZ6Wcv8BinaNUQBMQsgKLKNNLht5JPsBLN7ovt): protocol: expected piece hash; context canceled; EOF
Aug 13 22:10:44.899187002 (124h44m39.330267133s) [seg_pos={0 0}, upload=129816]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 22:10:44.899291421 (124h44m39.330371542s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 22:10:44.899296151 (124h44m39.330376282s) [upload=129816]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 22:10:45.214246215 (124h44m39.645326356s) [upload=129816]: Done uploading segments...
Aug 13 22:10:45.214268538 (124h44m39.645348669s) [upload=129816]: Upload finished. err: <nil>
Duration: 6.227568955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|