Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............................X.......] duration:
1.981843815s
FAIL (2025-08-20 02:04:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.981868704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X......................X........X.........X] duration:
4.197508041s
FAIL (2025-08-20 02:03:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 02:03:56.113045921 (272h37m50.544126053s) [upload=283486]: Starting upload
Aug 20 02:03:56.113090948 (272h37m50.544171079s) [upload=283486]: Done starting upload
Aug 20 02:03:56.113184066 (272h37m50.544264197s) [upload=283486]: Uploading segments...
Aug 20 02:03:56.113289678 (272h37m50.544369809s) [upload=283486]: Got next segment. Inline: false
Aug 20 02:03:56.113329324 (272h37m50.544409455s) [upload=283486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 02:03:56.113335486 (272h37m50.544415617s) [upload=283486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 02:03:56.566011147 (272h37m50.997091308s) [seg_pos={0 0}, upload=283486]: Begin upload segment...
Aug 20 02:03:56.566079357 (272h37m50.997159518s) [seg_pos={0 0}, upload=283486]: Done begin upload segment.
Aug 20 02:03:56.566110426 (272h37m50.997190557s) [noise=true , address=104.36.82.7:4924 , piece_id=DXWWYMFKCZ2EMXHTE2UROZCH37VE5GVEP4IM32XKD57XOAJKQ37Q, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.566134573 (272h37m50.997214694s) [noise=true , address=77.90.31.16:4744 , piece_id=XOESBCVFPBMX242XYGRBDYAXIBFTZDNLN57M6HG2CTO5TXVWSOCA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.566554397 (272h37m50.997634518s) [noise=true , address=104.36.82.23:4474 , piece_id=OURTLEDCWKYXIIHDU2FEH7MNVLU4WP6OB44RWRYSQ6S7OLZCODEQ, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.566589634 (272h37m50.997669765s) [noise=true , address=45.91.116.4:4971 , piece_id=YJTJBUHGF3KGFIOGFNAHXVSKAIDVSTUI7L3VO4XRPMNSOSHEFUJA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.566917742 (272h37m50.997997873s) [noise=true , address=77.90.31.17:4783 , piece_id=ZI6DXO2LSHQ2U52W7WRYHVUS6NO5KUXURIMGU23MJUQBVHJAA24Q, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.567237484 (272h37m50.998317615s) [noise=true , address=77.90.31.19:4867 , piece_id=HNTZERA46RG23MEZPIA2Z4QZR65JOICFOCK56WGYWZMGNOD6LOZA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.567513121 (272h37m50.998593252s) [noise=true , address=64.49.13.137:4496 , piece_id=K3PSI3RUGYOQ3KKAUCSQEQICE3D62EXKJ7UY3OWO45CDSSF6U4RA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.567749573 (272h37m50.998829704s) [noise=true , address=104.36.82.10:4099 , piece_id=NCTU62I6CURMQEBKG52XR2A3TUBLEQQJCQCEN4ZKPKEKHGB4SB5Q, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.567958924 (272h37m50.999039055s) [noise=true , address=77.90.31.10:4523 , piece_id=6VFUTVFRRJRLDUCZ7XQKGHAOROTQBXNGXQUFC6NADBLNL5BTDMFA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.568633514 (272h37m50.999713645s) [noise=true , address=77.90.31.11:4570 , piece_id=VM2JLCWPKUH3IC5EDG4NYYLZ2VWUKTAJJLFXEL52K37ASYZPYLTA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.569952950 (272h37m51.001033081s) [noise=true , address=45.91.116.9:4290 , piece_id=3TDJOF5WMDGXDRSGT4VRI23BTFWWWBB3DYK263OFU5RPDPHNKEUQ, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.571409356 (272h37m51.002489477s) [noise=true , address=104.36.82.34:4567 , piece_id=24ZQLAAOFGTTNKZBTLKZ3F4SDAXGFOVAP2VDPKUZC4D4FTENDNGQ, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.571924532 (272h37m51.003004663s) [noise=true , address=104.36.82.49:4000 , piece_id=5GSIVY7LIMD7OSAKDQATLFSPD7Q3UWZ7DALBPAFMGWYX3MFFCQFQ, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.572835375 (272h37m51.003915506s) [noise=true , address=79.127.219.48:4108 , piece_id=JJS33VLPO3LQJVWSDGP3JZVD7S653H3N4EZL5I76SECCHGUPPR2A, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.573257652 (272h37m51.004337813s) [noise=true , address=66.23.193.175:4556 , piece_id=ZEMZFFUM4LLZ63QICUZF55SSAIIEB6N52DLCYAKUIE2LMJW3CZAA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.573723884 (272h37m51.004804005s) [noise=true , address=77.90.31.21:4901 , piece_id=2SUTKAXIURVOUUU36E7NLMZWA7IKXQH2FD5MUHUBMV25XIIBQPNA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.574565826 (272h37m51.005645957s) [noise=true , address=104.36.82.39:4756 , piece_id=O77JO3C6FZTF4IVZVJYM4TCE2FAVV6FUESACQKSBHKP47G5BZ3AA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:56.574839870 (272h37m51.005920001s) [noise=true , address=104.36.82.62:4419 , piece_id=EN43VKDG7GBA4Y46TUMBNTTUF46INER37AUB2WYDCGBTETDDD7BA, seg_pos={0 0}, upload=283486]: Uploading piece...
Aug 20 02:03:57.741155368 (272h37m52.172235499s) [upload=283486]: Next returned nil segment
Aug 20 02:03:57.741174415 (272h37m52.172254546s) [upload=283486]: Waiting for error group managing segments...
Aug 20 02:03:58.023524769 (272h37m52.4546049s) [noise=true , address=66.23.193.175:4556 , piece_id=ZEMZFFUM4LLZ63QICUZF55SSAIIEB6N52DLCYAKUIE2LMJW3CZAA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.042863000 (272h37m52.473943131s) [noise=true , address=64.49.13.137:4496 , piece_id=K3PSI3RUGYOQ3KKAUCSQEQICE3D62EXKJ7UY3OWO45CDSSF6U4RA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.468653831 (272h37m52.899733962s) [noise=true , address=79.127.219.48:4108 , piece_id=JJS33VLPO3LQJVWSDGP3JZVD7S653H3N4EZL5I76SECCHGUPPR2A, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.472018128 (272h37m52.903098259s) [noise=true , address=45.91.116.4:4971 , piece_id=YJTJBUHGF3KGFIOGFNAHXVSKAIDVSTUI7L3VO4XRPMNSOSHEFUJA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.491876244 (272h37m52.922956375s) [noise=true , address=104.36.82.34:4567 , piece_id=24ZQLAAOFGTTNKZBTLKZ3F4SDAXGFOVAP2VDPKUZC4D4FTENDNGQ, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.503779330 (272h37m52.934859461s) [noise=true , address=104.36.82.62:4419 , piece_id=EN43VKDG7GBA4Y46TUMBNTTUF46INER37AUB2WYDCGBTETDDD7BA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.520911120 (272h37m52.951991251s) [noise=true , address=77.90.31.16:4744 , piece_id=XOESBCVFPBMX242XYGRBDYAXIBFTZDNLN57M6HG2CTO5TXVWSOCA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.560424694 (272h37m52.991504825s) [noise=true , address=104.36.82.39:4756 , piece_id=O77JO3C6FZTF4IVZVJYM4TCE2FAVV6FUESACQKSBHKP47G5BZ3AA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.573405842 (272h37m53.004485973s) [noise=true , address=104.36.82.23:4474 , piece_id=OURTLEDCWKYXIIHDU2FEH7MNVLU4WP6OB44RWRYSQ6S7OLZCODEQ, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.622442898 (272h37m53.053523029s) [noise=true , address=104.36.82.7:4924 , piece_id=DXWWYMFKCZ2EMXHTE2UROZCH37VE5GVEP4IM32XKD57XOAJKQ37Q, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.623537973 (272h37m53.054618094s) [noise=true , address=104.36.82.49:4000 , piece_id=5GSIVY7LIMD7OSAKDQATLFSPD7Q3UWZ7DALBPAFMGWYX3MFFCQFQ, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.673569232 (272h37m53.104649354s) [noise=true , address=77.90.31.17:4783 , piece_id=ZI6DXO2LSHQ2U52W7WRYHVUS6NO5KUXURIMGU23MJUQBVHJAA24Q, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.690491221 (272h37m53.121571352s) [noise=true , address=104.36.82.10:4099 , piece_id=NCTU62I6CURMQEBKG52XR2A3TUBLEQQJCQCEN4ZKPKEKHGB4SB5Q, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.857339175 (272h37m53.288419296s) [noise=true , address=77.90.31.19:4867 , piece_id=HNTZERA46RG23MEZPIA2Z4QZR65JOICFOCK56WGYWZMGNOD6LOZA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: <nil>
Aug 20 02:03:58.857357170 (272h37m53.288437301s) [seg_pos={0 0}, upload=283486]: Segment reached optimal threshold of 14 pieces.
Aug 20 02:03:58.857485655 (272h37m53.288565786s) [noise=true , address=77.90.31.10:4523 , piece_id=6VFUTVFRRJRLDUCZ7XQKGHAOROTQBXNGXQUFC6NADBLNL5BTDMFA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa): protocol: expected piece hash; context canceled; EOF
Aug 20 02:03:58.857989540 (272h37m53.289069671s) [noise=true , address=77.90.31.21:4901 , piece_id=2SUTKAXIURVOUUU36E7NLMZWA7IKXQH2FD5MUHUBMV25XIIBQPNA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vnJeNLPrxvFyZMsfC61nZB1t3n77x9qgmjrYAhH6wyc7KfC9U): protocol: expected piece hash; context canceled; EOF
Aug 20 02:03:58.858038212 (272h37m53.289118353s) [noise=true , address=77.90.31.11:4570 , piece_id=VM2JLCWPKUH3IC5EDG4NYYLZ2VWUKTAJJLFXEL52K37ASYZPYLTA, seg_pos={0 0}, upload=283486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq): protocol: read tcp 188.166.225.170:33622->77.90.31.11:4570: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 20 02:03:58.858088849 (272h37m53.28916898s) [noise=true , address=45.91.116.9:4290 , piece_id=3TDJOF5WMDGXDRSGT4VRI23BTFWWWBB3DYK263OFU5RPDPHNKEUQ, seg_pos={0 0}, upload=283486]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF
Aug 20 02:03:58.858100903 (272h37m53.289181034s) [seg_pos={0 0}, upload=283486]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 02:03:58.858161789 (272h37m53.28924192s) [upload=283486]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 02:03:58.858166167 (272h37m53.289246298s) [upload=283486]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 02:03:59.205307843 (272h37m53.636387974s) [upload=283486]: Done uploading segments...
Aug 20 02:03:59.205324875 (272h37m53.636405006s) [upload=283486]: Upload finished. err: <nil>
Duration: 4.197535023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............................X......] duration:
2.016262832s
FAIL (2025-08-20 02:03:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.01628727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X......................X........X.........] duration:
5.815319122s
FAIL (2025-08-20 02:03:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.815352727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............................X.....] duration:
2.217396294s
FAIL (2025-08-20 02:02:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.217426341s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X......................X........X........] duration:
6.107391058s
FAIL (2025-08-20 02:02:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 6.107416084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............................X....] duration:
2.139130556s
FAIL (2025-08-20 02:01:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.139164681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X......................X........X.......] duration:
5.856452966s
FAIL (2025-08-20 02:01:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.856474156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X......................X........X......] duration:
6.013793374s
FAIL (2025-08-20 02:00:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 6.013817641s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............................X...] duration:
1.859977698s
FAIL (2025-08-20 02:00:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.860004479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X......................X........X.....] duration:
5.738780814s
FAIL (2025-08-20 02:00:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.738811633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............................X..] duration:
1.833659733s
FAIL (2025-08-20 02:00:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833693828s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............................X.] duration:
2.096042171s
FAIL (2025-08-20 01:59:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.09606763s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X......................X........X....] duration:
5.878498638s
FAIL (2025-08-20 01:59:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.87852022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X............................X.............................X] duration:
864.676317ms
FAIL (2025-08-20 01:59:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:59:00.281427346 (272h32m54.712507477s) [upload=283404]: Starting upload Aug 20 01:59:00.281476810 (272h32m54.712556941s) [upload=283404]: Done starting upload Aug 20 01:59:00.281523790 (272h32m54.712603911s) [upload=283404]: Uploading segments... Aug 20 01:59:00.281574888 (272h32m54.712655019s) [upload=283404]: Got next segment. Inline: true Aug 20 01:59:00.281578715 (272h32m54.712658846s) [upload=283404]: Waiting for error group managing segments... Aug 20 01:59:00.281612730 (272h32m54.712692861s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:59:00.281616388 (272h32m54.712696509s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:59:00.281618762 (272h32m54.712698894s) [upload=283404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:59:00.494922014 (272h32m54.926002145s) [upload=283404]: Done uploading segments... Aug 20 01:59:00.494938715 (272h32m54.926018846s) [upload=283404]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.705192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X......................X........X...] duration:
5.764851147s
FAIL (2025-08-20 01:58:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.76487808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X............................X.............................] duration:
1.91984587s
FAIL (2025-08-20 01:58:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.919864446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X............................X............................] duration:
1.934696795s
FAIL (2025-08-20 01:57:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.934721152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X......................X........X..] duration:
5.769394857s
FAIL (2025-08-20 01:57:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 5.76941713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X......................X........X.] duration:
6.006260597s
FAIL (2025-08-20 01:56:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 6.006281606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X............................X...........................] duration:
2.183973889s
FAIL (2025-08-20 01:56:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.183993184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X......................X........X] duration:
4.104084844s
FAIL (2025-08-20 01:55:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 01:55:20.947081770 (272h29m15.378161901s) [upload=283341]: Starting upload
Aug 20 01:55:20.947119301 (272h29m15.378199432s) [upload=283341]: Done starting upload
Aug 20 01:55:20.947292393 (272h29m15.378372514s) [upload=283341]: Uploading segments...
Aug 20 01:55:20.947331006 (272h29m15.378411137s) [upload=283341]: Got next segment. Inline: false
Aug 20 01:55:20.947359521 (272h29m15.378439652s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:55:20.947363498 (272h29m15.378443619s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:55:21.490488525 (272h29m15.921568646s) [seg_pos={0 0}, upload=283341]: Begin upload segment...
Aug 20 01:55:21.490532047 (272h29m15.921612178s) [seg_pos={0 0}, upload=283341]: Done begin upload segment.
Aug 20 01:55:21.490565602 (272h29m15.921645844s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.490979735 (272h29m15.922059866s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491282474 (272h29m15.922362605s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491598057 (272h29m15.922678238s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.491906116 (272h29m15.922986247s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492200249 (272h29m15.92328038s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492433196 (272h29m15.923513327s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492674286 (272h29m15.923754417s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.492892524 (272h29m15.923972655s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493145148 (272h29m15.924225279s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493361150 (272h29m15.924441281s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.493580189 (272h29m15.924660321s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.497942006 (272h29m15.929022137s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504158190 (272h29m15.935238321s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.504827971 (272h29m15.935908102s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.505662007 (272h29m15.936742138s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.506304155 (272h29m15.937384287s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:21.507932822 (272h29m15.939012953s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Uploading piece...
Aug 20 01:55:23.003896250 (272h29m17.434976401s) [upload=283341]: Next returned nil segment
Aug 20 01:55:23.003914956 (272h29m17.434995087s) [upload=283341]: Waiting for error group managing segments...
Aug 20 01:55:23.404546638 (272h29m17.835626769s) [noise=true , address=104.36.82.43:4838 , piece_id=UDSLSFYAP5PXOI5CPMSW57M65DRM2GTHZ745GXZ6LOEATNV3GXIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.409047489 (272h29m17.84012762s) [noise=true , address=45.91.116.8:4073 , piece_id=K6UAUB5EULRA6GYO3ESM2ZJ4WSFRUJPI6FIIZQCKLEN5MWXEWJDA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.425942517 (272h29m17.857022648s) [noise=true , address=77.90.31.18:4808 , piece_id=BAQOQUELFQZDU7JJBPD7QZPEDDZJASWGAD2Z7BBB5ZWM4ILO3F4Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.450007701 (272h29m17.881087822s) [noise=true , address=77.90.31.15:4706 , piece_id=5RVKLU42EMXPWXCREBOV6ZYXNDYHAFG3DSNMVSLP3ZQB4HSZ72GA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.454149656 (272h29m17.885229787s) [noise=true , address=77.90.31.12:4607 , piece_id=X4SY6UALPJ5AEKGSDUVS6EWECXGK43VTM7CHDLHI33CPM2MAXHJQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477506608 (272h29m17.908586739s) [noise=true , address=104.36.82.60:4352 , piece_id=2AGDRAZUIIEIRMG6OAET4W5XG3MTKZSLDWKP6M5DPQ2VBCAHHEZA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.477879822 (272h29m17.908959943s) [noise=true , address=77.90.31.17:4775 , piece_id=Q4HXTDURB553SA3VMENZ33RJH5MMBWOA34ODPJR4OW7KC4FV6RKA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.481105934 (272h29m17.912186066s) [noise=true , address=77.90.31.11:4581 , piece_id=TJEULLCH4JZCGDAZHCUAIJTSC5ZJPJHZWSXUBHAK63NSCPNIGFLQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507612061 (272h29m17.938692212s) [noise=true , address=45.91.116.7:4033 , piece_id=TECKMSHM33VQQ4Y5ZISU7QMV24GR5AUMIBWS22LNILJENB2Z3QFA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.507672095 (272h29m17.938752216s) [noise=true , address=104.36.82.7:4921 , piece_id=QMKO2JDSH6RTDOFVBQ2C47AVPBX5YHLBLSRCXB4MUPEX7S46YU5Q, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.516403543 (272h29m17.947483674s) [noise=true , address=45.91.116.9:4286 , piece_id=2AS3AKWZ4LRORRYHDEXEBQZXS27APTAAFYEXBBYMOMYAZAUBRPIA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.522257663 (272h29m17.953337795s) [noise=true , address=45.91.116.12:4232 , piece_id=KULXF5LLAJSF5U6KI7C3J3F7NOFFK3QCKEEVUQWW5YVVCHY2KLEQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.537756990 (272h29m17.968837121s) [noise=true , address=104.36.82.12:4157 , piece_id=LNXV56LAM4SJN3SOLPKLP3AZIIH4X4ZRV7RXKUECDX3OU56E3ADA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556635802 (272h29m17.987715933s) [noise=true , address=104.36.82.61:4386 , piece_id=XLX7AW3QNWFVQTCYYWEVN6OGHVLSOOBJ7POIJWZ7BYWHKX5NS43A, seg_pos={0 0}, upload=283341]: Done uploading piece. err: <nil>
Aug 20 01:55:23.556662032 (272h29m17.987742163s) [seg_pos={0 0}, upload=283341]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:55:23.556768656 (272h29m17.987848777s) [noise=true , address=77.90.31.14:4691 , piece_id=KVOAO7BBTFKADJPB4K5UJWVOIHQZDGM3GLJPYKSQ66V3JQDUJLYA, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TxXc8GpnEATg9PMHcQxRFYUz7STpdzMuQsFXkiM9DgzchDRjJ): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556832960 (272h29m17.987913091s) [noise=true , address=45.91.116.6:4997 , piece_id=CB2EL7Y77D5KTBPFLFKIYNWLNJBS2532POL6C3JTBFMCPK7RJGMQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YzWUkjkJXsP2Y5JYoFBM8Z8gsFbC5hzNGbWRgRTwg4uGge71p): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556860332 (272h29m17.987940463s) [noise=true , address=104.36.82.23:4470 , piece_id=A5FUAC4EK35XZ322M72TZXXKRCFX5WCQ3Z5S5QUMRHP3Q7NOUOAQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556920237 (272h29m17.988000358s) [noise=true , address=77.90.31.10:4550 , piece_id=SBHTVUNKRKPCPTV2KGNARQQES7NQMYF4O3EFBWC4PRUOIOLC6IUQ, seg_pos={0 0}, upload=283341]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7): protocol: expected piece hash; context canceled; EOF
Aug 20 01:55:23.556957097 (272h29m17.988037238s) [seg_pos={0 0}, upload=283341]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:55:23.557030538 (272h29m17.988110669s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:55:23.557034666 (272h29m17.988114797s) [upload=283341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:55:23.905759710 (272h29m18.336839841s) [upload=283341]: Done uploading segments...
Aug 20 01:55:23.905780120 (272h29m18.336860251s) [upload=283341]: Upload finished. err: <nil>
Duration: 4.104111105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X............................X..........................] duration:
1.844402817s
FAIL (2025-08-20 01:55:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844496827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X......................X........] duration:
5.721444654s
FAIL (2025-08-20 01:54:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.721469141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X............................X.........................] duration:
1.939751765s
FAIL (2025-08-20 01:54:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.939773978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration:
5.916289076s
FAIL (2025-08-20 01:54:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.916319234s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X............................X........................] duration:
1.875924712s
FAIL (2025-08-20 01:54:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875943498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X......................X......] duration:
6.040787604s
FAIL (2025-08-20 01:53:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 6.04081126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X............................X.......................] duration:
2.062934092s
FAIL (2025-08-20 01:53:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.062964119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration:
5.889285907s
FAIL (2025-08-20 01:52:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.889305305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......X............................X......................] duration:
1.966138695s
FAIL (2025-08-20 01:52:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.96616748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X......................X....] duration:
5.701621191s
FAIL (2025-08-20 01:51:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.701646992s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X............................X.....................] duration:
1.838423215s
FAIL (2025-08-20 01:51:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838449154s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......................X...] duration:
5.795752265s
FAIL (2025-08-20 01:51:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.795768996s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X............................X....................] duration:
1.868046198s
FAIL (2025-08-20 01:51:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.868065204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......................X..] duration:
5.700043636s
FAIL (2025-08-20 01:51:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.700135522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......................X.] duration:
5.946804203s
FAIL (2025-08-20 01:50:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 5.946830974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X............................X...................] duration:
1.874094089s
FAIL (2025-08-20 01:50:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.874122554s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X............................X..................] duration:
1.919120499s
FAIL (2025-08-20 01:49:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.919147019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X............................X.................] duration:
1.881371434s
FAIL (2025-08-20 01:49:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.881393537s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
4.172779485s
FAIL (2025-08-20 01:49:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 01:49:15.572796461 (272h23m10.003876592s) [upload=283229]: Starting upload
Aug 20 01:49:15.572853219 (272h23m10.00393335s) [upload=283229]: Done starting upload
Aug 20 01:49:15.572931820 (272h23m10.004011951s) [upload=283229]: Uploading segments...
Aug 20 01:49:15.573107476 (272h23m10.004187617s) [upload=283229]: Got next segment. Inline: false
Aug 20 01:49:15.573174493 (272h23m10.004254654s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:49:15.573182760 (272h23m10.004262921s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:49:16.038090055 (272h23m10.469170186s) [seg_pos={0 0}, upload=283229]: Begin upload segment...
Aug 20 01:49:16.038159988 (272h23m10.469240119s) [seg_pos={0 0}, upload=283229]: Done begin upload segment.
Aug 20 01:49:16.038181990 (272h23m10.469262121s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038483317 (272h23m10.469563448s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038612294 (272h23m10.469692425s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.038913731 (272h23m10.469993852s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039062245 (272h23m10.470142366s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039207954 (272h23m10.470288085s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039444987 (272h23m10.470525108s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039559416 (272h23m10.470639547s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039800908 (272h23m10.470881039s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.039931027 (272h23m10.471011148s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040215832 (272h23m10.471295963s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040301677 (272h23m10.471381808s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040563848 (272h23m10.471643969s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040629263 (272h23m10.471709404s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040843262 (272h23m10.471923383s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.040959946 (272h23m10.472040078s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041300668 (272h23m10.472380799s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:16.041602936 (272h23m10.472683057s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Uploading piece...
Aug 20 01:49:17.520631644 (272h23m11.951711775s) [upload=283229]: Next returned nil segment
Aug 20 01:49:17.520651292 (272h23m11.951731423s) [upload=283229]: Waiting for error group managing segments...
Aug 20 01:49:17.897055658 (272h23m12.328135789s) [noise=true , address=79.127.220.98:4425 , piece_id=SMKOWQE3MX3YUQDE3AHLRFV3NJMUPXZW46OAVMMUMFSIZXBOTXVA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.951610402 (272h23m12.382690543s) [noise=true , address=77.90.31.14:4664 , piece_id=7BMKBWEFGRER54F7CJADKRCAVGVLIL6E4ULQ5JIHQ6CGIKC7X77Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.957366055 (272h23m12.388446186s) [noise=true , address=104.36.82.14:4244 , piece_id=O362YBSCJGIAC5JSWZVPQ5CKHZDM3WY5GM3DB4NWMA6UESYNKXTQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.959714919 (272h23m12.390795051s) [noise=true , address=104.36.82.9:4018 , piece_id=XZVMAWLABTRKR2P6ZWGQH76TSBAHPS7R2OLN766RL4D4Y53FOIWA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.985122935 (272h23m12.416203086s) [noise=true , address=77.90.31.10:4552 , piece_id=O4SY5UKND4KMZKJZHC332VKKHPNHCMV5VGHRCLHLO77QTODLKONQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:17.993840264 (272h23m12.424920395s) [noise=true , address=104.36.82.18:4398 , piece_id=QXYJUER76XQJR6MTP3WEEHMWCW5IHGQ7AKPD3BTBAR3B4DAUQFSA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.026820127 (272h23m12.457900258s) [noise=true , address=77.90.31.11:4565 , piece_id=2IFINGTBYEA5TK4Z6VAEXUIQAIK4CUSQYJ26QD7UWD6UAWE34F6Q, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.027954588 (272h23m12.459034719s) [noise=true , address=104.36.82.5:4845 , piece_id=KOJWSO6WTPHMZXH5VYYJATABVAEAVDBDWPVNKDWVJ2Z5MKZZYXBQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.037699824 (272h23m12.468779955s) [noise=true , address=77.90.31.10:4540 , piece_id=JO6DVFEGDWCD4EVH3CIYIFBQHTL2TS6QC6EG7UYE3QVUTWU2GPRQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.040038840 (272h23m12.471118971s) [noise=true , address=104.36.82.49:4996 , piece_id=MBQV2NPWMQGBZ6LAUWMSWZPB2DAEEJNIST6PN7E435IXGJUGCGCQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.052600865 (272h23m12.483680986s) [noise=true , address=77.90.31.16:4761 , piece_id=SFFYZ3YCMP7PPNPLGKLNH3VUSIETNZDZ2IUA2DZ2PXLBXQS3KBPQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.053144986 (272h23m12.484225117s) [noise=true , address=77.90.31.15:4713 , piece_id=RLWIPYVTUXUDWNTCAQ6A2NRORNYR6PHDMHFPRPA5OGCMRUS4Y6PQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.057244431 (272h23m12.488324562s) [noise=true , address=104.36.82.62:4430 , piece_id=OLRHDUJE7TGMARM2ET4QT6MMMCAJG6ISCDPIHSV63D3UUDWTOW4A, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073022219 (272h23m12.504102361s) [noise=true , address=45.91.116.4:4949 , piece_id=2C37LEYFVMV4JV5J5SOM6LZTQISH2IWH6A36NVD4SF3X7NACC3YQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: <nil>
Aug 20 01:49:18.073060302 (272h23m12.504140443s) [seg_pos={0 0}, upload=283229]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:49:18.073194078 (272h23m12.504274219s) [noise=true , address=104.36.82.11:4125 , piece_id=CBWFMGGRK5YER63XRTDYQRFGI6UU2QJZ3YQDC7BWL26UE7JUFXEA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073297115 (272h23m12.504377246s) [noise=true , address=104.36.82.60:4367 , piece_id=E3T4HAXQJIAVP4OYO7J3BK6GBDFEPWCQXALOKSSNTZIUTRETTTCA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073477500 (272h23m12.504557681s) [noise=true , address=45.91.116.14:4212 , piece_id=D2UKRYZQGJQK2WDBTKYRLLE6Y6RCUU5GF56EDJL22E2BM7DGVWAA, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RiikePNRVqnERsVeC6eFxkTpttN5bkps9fwmntzX7EsxPAW6y): protocol: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41490->45.91.116.14:4212: use of closed network connection
Aug 20 01:49:18.073519551 (272h23m12.504599702s) [noise=true , address=77.90.31.13:4630 , piece_id=VDYGHTZAOSODMTVKVYO3MXWSD7UYB534K23IKNU2RWJQ4TOWMUQQ, seg_pos={0 0}, upload=283229]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gyQJLnzWmRESyd8m6G7aZWsQwVfqRQNARxRmd7GwwfYwhuzVn): protocol: expected piece hash; context canceled; EOF
Aug 20 01:49:18.073560749 (272h23m12.50464094s) [seg_pos={0 0}, upload=283229]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:49:18.073663045 (272h23m12.504743176s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:49:18.073670239 (272h23m12.50475041s) [upload=283229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:49:18.409061792 (272h23m12.840141923s) [upload=283229]: Done uploading segments...
Aug 20 01:49:18.409079305 (272h23m12.840159437s) [upload=283229]: Upload finished. err: <nil>
Duration: 4.172806989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.64521743s
FAIL (2025-08-20 01:48:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:31:11.034261687 (272h5m5.465341818s) [upload=282925]: Starting upload Aug 20 01:31:11.034314909 (272h5m5.46539504s) [upload=282925]: Done starting upload Aug 20 01:31:11.034505724 (272h5m5.465585856s) [upload=282925]: Uploading segments... Aug 20 01:31:11.034553256 (272h5m5.465633387s) [upload=282925]: Got next segment. Inline: false Aug 20 01:31:11.034588843 (272h5m5.465668975s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:31:11.034593663 (272h5m5.465673814s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 01:31:11.246076697 (272h5m5.677156828s) [upload=282925]: Next segment err: metaclient: Too Many Requests Aug 20 01:31:11.246104329 (272h5m5.677184461s) [upload=282925]: Done uploading segments... Aug 20 01:31:11.246118566 (272h5m5.677198697s) [upload=282925]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.645246466s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X............................X................] duration:
1.968578574s
FAIL (2025-08-20 01:48:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.96861891s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.932243634s
FAIL (2025-08-20 01:48:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:31:11.034261687 (272h5m5.465341818s) [upload=282925]: Starting upload Aug 20 01:31:11.034314909 (272h5m5.46539504s) [upload=282925]: Done starting upload Aug 20 01:31:11.034505724 (272h5m5.465585856s) [upload=282925]: Uploading segments... Aug 20 01:31:11.034553256 (272h5m5.465633387s) [upload=282925]: Got next segment. Inline: false Aug 20 01:31:11.034588843 (272h5m5.465668975s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:31:11.034593663 (272h5m5.465673814s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 01:31:11.246076697 (272h5m5.677156828s) [upload=282925]: Next segment err: metaclient: Too Many Requests Aug 20 01:31:11.246104329 (272h5m5.677184461s) [upload=282925]: Done uploading segments... Aug 20 01:31:11.246118566 (272h5m5.677198697s) [upload=282925]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.9322683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
6.094875347s
FAIL (2025-08-20 01:47:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:31:11.034261687 (272h5m5.465341818s) [upload=282925]: Starting upload Aug 20 01:31:11.034314909 (272h5m5.46539504s) [upload=282925]: Done starting upload Aug 20 01:31:11.034505724 (272h5m5.465585856s) [upload=282925]: Uploading segments... Aug 20 01:31:11.034553256 (272h5m5.465633387s) [upload=282925]: Got next segment. Inline: false Aug 20 01:31:11.034588843 (272h5m5.465668975s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:31:11.034593663 (272h5m5.465673814s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 01:31:11.246076697 (272h5m5.677156828s) [upload=282925]: Next segment err: metaclient: Too Many Requests Aug 20 01:31:11.246104329 (272h5m5.677184461s) [upload=282925]: Done uploading segments... Aug 20 01:31:11.246118566 (272h5m5.677198697s) [upload=282925]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.094942056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X............................X...............] duration:
1.877495175s
FAIL (2025-08-20 01:47:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.877523549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
6.070018961s
FAIL (2025-08-20 01:46:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:31:11.034261687 (272h5m5.465341818s) [upload=282925]: Starting upload Aug 20 01:31:11.034314909 (272h5m5.46539504s) [upload=282925]: Done starting upload Aug 20 01:31:11.034505724 (272h5m5.465585856s) [upload=282925]: Uploading segments... Aug 20 01:31:11.034553256 (272h5m5.465633387s) [upload=282925]: Got next segment. Inline: false Aug 20 01:31:11.034588843 (272h5m5.465668975s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:31:11.034593663 (272h5m5.465673814s) [upload=282925]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 01:31:11.246076697 (272h5m5.677156828s) [upload=282925]: Next segment err: metaclient: Too Many Requests Aug 20 01:31:11.246104329 (272h5m5.677184461s) [upload=282925]: Done uploading segments... Aug 20 01:31:11.246118566 (272h5m5.677198697s) [upload=282925]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.070039539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.......X.......X............................X..............] duration:
1.828061768s
FAIL (2025-08-20 01:46:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.82808325s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.......X.......X............................X.............] duration:
1.817892872s
FAIL (2025-08-20 01:45:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.81791838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.......X.......X............................X............] duration:
2.258958429s
FAIL (2025-08-20 01:45:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 01:35:06.174623154 (272h9m0.605703275s) [upload=282989]: Starting upload Aug 20 01:35:06.174681976 (272h9m0.605762097s) [upload=282989]: Done starting upload Aug 20 01:35:06.174750647 (272h9m0.605830778s) [upload=282989]: Uploading segments... Aug 20 01:35:06.174798449 (272h9m0.60587858s) [upload=282989]: Got next segment. Inline: true Aug 20 01:35:06.174802426 (272h9m0.605882558s) [upload=282989]: Waiting for error group managing segments... Aug 20 01:35:06.174833406 (272h9m0.605913527s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 01:35:06.174837133 (272h9m0.605917264s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 01:35:06.174839407 (272h9m0.605919528s) [upload=282989]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 01:35:06.391530264 (272h9m0.822610395s) [upload=282989]: Done uploading segments... Aug 20 01:35:06.391546084 (272h9m0.822626215s) [upload=282989]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.258976584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|