Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.....................................X...................X] duration:
1.642012242s
FAIL (2025-08-14 16:14:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 14 16:14:54.085716678 (142h48m48.516796809s) [upload=148538]: Starting upload Aug 14 16:14:54.085766954 (142h48m48.516847085s) [upload=148538]: Done starting upload Aug 14 16:14:54.085835765 (142h48m48.516915896s) [upload=148538]: Uploading segments... Aug 14 16:14:54.085910819 (142h48m48.51699095s) [upload=148538]: Got next segment. Inline: true Aug 14 16:14:54.085915928 (142h48m48.51699605s) [upload=148538]: Waiting for error group managing segments... Aug 14 16:14:54.085952598 (142h48m48.517032729s) [upload=148538]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:14:54.085956847 (142h48m48.517036978s) [upload=148538]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:14:54.085961877 (142h48m48.517042008s) [upload=148538]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:14:54.350513541 (142h48m48.781593672s) [upload=148538]: Done uploading segments... Aug 14 16:14:54.350532317 (142h48m48.781612448s) [upload=148538]: Upload finished. err: <nil>
Duration: 1.642041938s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X....................X.......X.X....X...............] duration:
5.614146341s
FAIL (2025-08-14 16:14:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.614166449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X....................X.......X.X....X..............] duration:
5.565036279s
FAIL (2025-08-14 16:14:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.565053411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
1.848375078s
FAIL (2025-08-14 16:14:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.848400618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
1.900918102s
FAIL (2025-08-14 16:13:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.900945052s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X....................X.......X.X....X.............] duration:
5.665256461s
FAIL (2025-08-14 16:13:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.665282972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
1.855430477s
FAIL (2025-08-14 16:13:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.855457818s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X....................X.......X.X....X............] duration:
5.60350755s
FAIL (2025-08-14 16:12:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.60353369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
1.877067859s
FAIL (2025-08-14 16:11:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.87709458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration:
2.025664409s
FAIL (2025-08-14 16:11:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.025687482s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X....................X.......X.X....X...........] duration:
5.792152661s
FAIL (2025-08-14 16:11:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.792177679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X....................X.......X.X....X..........] duration:
5.572301754s
FAIL (2025-08-14 16:10:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.572328956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration:
1.838344378s
FAIL (2025-08-14 16:10:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838382773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X....................X.......X.X....X.........] duration:
5.732753617s
FAIL (2025-08-14 16:10:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.73277563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......X.....................................X.............] duration:
1.891682859s
FAIL (2025-08-14 16:10:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891744468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X....................X.......X.X....X........] duration:
5.652571922s
FAIL (2025-08-14 16:09:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.652598922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X.....................................X............] duration:
1.938618384s
FAIL (2025-08-14 16:09:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.938643431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X....................X.......X.X....X.......] duration:
5.607978911s
FAIL (2025-08-14 16:08:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.608003208s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X.....................................X...........] duration:
1.838455472s
FAIL (2025-08-14 16:08:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.838478015s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X.....................................X..........] duration:
1.930572609s
FAIL (2025-08-14 16:08:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.930596424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X....................X.......X.X....X......] duration:
5.617568012s
FAIL (2025-08-14 16:08:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.617595103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X.....................................X.........] duration:
1.859708078s
FAIL (2025-08-14 16:07:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.85973573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X....................X.......X.X....X.....] duration:
5.905169353s
FAIL (2025-08-14 16:07:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.905186848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X.....................................X........] duration:
2.242604818s
FAIL (2025-08-14 16:06:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.242658291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X....................X.......X.X....X....] duration:
5.787319452s
FAIL (2025-08-14 16:06:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.787346504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X.....................................X.......] duration:
1.86768947s
FAIL (2025-08-14 16:06:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.867714238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X.....................................X......] duration:
1.832786355s
FAIL (2025-08-14 16:05:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832806713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X....................X.......X.X....X...] duration:
5.743034883s
FAIL (2025-08-14 16:04:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.743062707s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.......X.......X.....................................X.....] duration:
2.183981776s
FAIL (2025-08-14 16:04:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.184006854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X....................X.......X.X....X..] duration:
5.616601504s
FAIL (2025-08-14 16:04:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.616630288s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.......X.......X.....................................X....] duration:
1.849977408s
FAIL (2025-08-14 16:03:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.85000424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X....................X.......X.X....X.] duration:
5.867835188s
FAIL (2025-08-14 16:03:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 5.867863813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X....................X.......X.X....X] duration:
4.085417157s
FAIL (2025-08-14 16:02:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 16:02:27.542940116 (142h36m21.974020247s) [upload=148332]: Starting upload
Aug 14 16:02:27.542993778 (142h36m21.974073909s) [upload=148332]: Done starting upload
Aug 14 16:02:27.543084602 (142h36m21.974164733s) [upload=148332]: Uploading segments...
Aug 14 16:02:27.543175286 (142h36m21.974255457s) [upload=148332]: Got next segment. Inline: false
Aug 14 16:02:27.543217476 (142h36m21.974297607s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 16:02:27.543222265 (142h36m21.974302386s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 16:02:28.005362546 (142h36m22.436442677s) [seg_pos={0 0}, upload=148332]: Begin upload segment...
Aug 14 16:02:28.005421017 (142h36m22.436501149s) [seg_pos={0 0}, upload=148332]: Done begin upload segment.
Aug 14 16:02:28.005443661 (142h36m22.436523792s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005477335 (142h36m22.436557466s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005889764 (142h36m22.436969895s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.005919150 (142h36m22.436999282s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006204706 (142h36m22.437284837s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006221088 (142h36m22.437301219s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006475154 (142h36m22.437555285s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006494521 (142h36m22.437574652s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.006770489 (142h36m22.43785062s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007036799 (142h36m22.43811693s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007263773 (142h36m22.438343904s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007474587 (142h36m22.438554718s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007770824 (142h36m22.438850965s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.007984021 (142h36m22.439064152s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008180237 (142h36m22.439260368s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008407302 (142h36m22.439487433s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008604639 (142h36m22.43968477s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:28.008795925 (142h36m22.439876056s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Uploading piece...
Aug 14 16:02:29.455868325 (142h36m23.886948456s) [upload=148332]: Next returned nil segment
Aug 14 16:02:29.455887142 (142h36m23.886967273s) [upload=148332]: Waiting for error group managing segments...
Aug 14 16:02:29.873651904 (142h36m24.304732035s) [noise=true , address=79.127.220.101:4075 , piece_id=3U5C3YD6TKTPM3ZSZEALXZPDNINAJOYZXGPLTN7LBODFOW6Q4IQA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.922261102 (142h36m24.353341233s) [noise=true , address=104.36.82.39:4744 , piece_id=R7H56XFNPOSDX3K72YZQK4NNNVW26JHULVA74QH5FYZE5UW2R7YQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.923179349 (142h36m24.35425948s) [noise=true , address=77.90.31.12:4606 , piece_id=L554WN54XQND42LDSFFGDC4HOK2PRVXJZ2KMDFLAA3DPI6YAFHVQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.946949060 (142h36m24.378029191s) [noise=true , address=104.36.82.34:4548 , piece_id=P7QLR4KLF7ZZWZGSLULDVUTN5UAZHUKQITUZRBX4FYDHMRF3X6JQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.958480664 (142h36m24.389560795s) [noise=true , address=104.36.82.41:4795 , piece_id=FRRDMWHIT3AUMHB3DKJ3BMW5UACWFT7JF2YWY3XS3AMJUFN5BA3Q, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.967925996 (142h36m24.399006127s) [noise=true , address=104.36.82.34:4550 , piece_id=YG52LWLLFVRGBFUHZ5GU5ETH3Q5VKYDL7PZ5GCMUQ7EX3RZMORLA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:29.991941016 (142h36m24.423021137s) [noise=true , address=77.90.31.14:4674 , piece_id=LMANQRO4NHGRL3M4U4RNRKJKAP7RJUMQXLUL2UEIORF67OPJFVZQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.004324010 (142h36m24.435404141s) [noise=true , address=77.90.31.19:4844 , piece_id=ZIJE2RMVNOJNDIV63SCKH5BZFDAAI7T6VS2FD63BSKE7YTXFVUYQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.014662942 (142h36m24.445743073s) [noise=true , address=104.36.82.37:4666 , piece_id=YZZ5US75PRG3LANNLS426QNJTN5G3APWYFEB76QYZ4R5GQ54CVJA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.030363613 (142h36m24.461443744s) [noise=true , address=104.36.82.61:4375 , piece_id=3XCQCU5HJT4RB2LKI7WMC4CPC7IX6OTAK3BOGWF546DQBPRLWJ6A, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.064829910 (142h36m24.495910031s) [noise=true , address=77.90.31.17:4782 , piece_id=PSQW6HXIXIMFM6RHLGVI7C3QQFLFOOIBLSIRWV5JARQJUSZNX4DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.086392438 (142h36m24.517472569s) [noise=true , address=104.36.82.21:4508 , piece_id=KAPFKHVLXB5OXXZA6VMXOB3JOQJSUPZUBABZWN3EHVQPPKALCSHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.091765108 (142h36m24.522845229s) [noise=true , address=104.36.82.17:4357 , piece_id=LK3HSDF5KYG6NVZ3IDMFURM76YBYG7HBAVJOEYA5NLLIDXNS56DQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112102320 (142h36m24.543182451s) [noise=true , address=104.36.82.38:4710 , piece_id=4Q74LM74Y3BX7TWCKHM673UD7F5OARKYJKOJEPKAFTS2QMRPO2NQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: <nil>
Aug 14 16:02:30.112132097 (142h36m24.543212228s) [seg_pos={0 0}, upload=148332]: Segment reached optimal threshold of 14 pieces.
Aug 14 16:02:30.112258590 (142h36m24.543338721s) [noise=true , address=104.36.82.23:4463 , piece_id=F4LSN4Y3TJHRUZ5MNQRQBVDKSHVU4XS6E6H6D7NIXMOOWJVUTJWA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d3ACC8cWirsfXo2XNPTtr6sULutTpdEpvFDweeiQuPQ3NiZyL): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112421692 (142h36m24.543501823s) [noise=true , address=104.36.82.36:4628 , piece_id=3CMREDHOLA2HOG5YSDAAYWIUZUM7SPCBPHQ3CLPCFD3NTOZLWWOQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9h3t9CQKukCffvjBC6XugNBCHguXyANBSqj6Qr98sqmPiqsp): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112495102 (142h36m24.543575223s) [noise=true , address=104.36.82.60:4340 , piece_id=AXFXRZ4PWUBG6B2VWSFG3GVZ7EWWY2UOUJLHLYTL2LXZN6XGHKHQ, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34438->104.36.82.60:4340: use of closed network connection
Aug 14 16:02:30.112534057 (142h36m24.543614188s) [noise=true , address=104.36.82.50:4022 , piece_id=PBFU6CLEGAPJIXA3UCM5I7XDHFMRUIGRWCKQPNW2O4W4KD3M5MOA, seg_pos={0 0}, upload=148332]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZPU1MyQ2Adj32UCvyosUGEEpKzg9riU9izZxqRuXRtEJLfse1): protocol: expected piece hash; context canceled; EOF
Aug 14 16:02:30.112573642 (142h36m24.543653773s) [seg_pos={0 0}, upload=148332]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 16:02:30.112663273 (142h36m24.543743404s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 16:02:30.112668013 (142h36m24.543748134s) [upload=148332]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 16:02:30.502430697 (142h36m24.933510828s) [upload=148332]: Done uploading segments...
Aug 14 16:02:30.502448491 (142h36m24.933528622s) [upload=148332]: Upload finished. err: <nil>
Duration: 4.085452092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.......X.......X.....................................X...] duration:
1.893916091s
FAIL (2025-08-14 16:02:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.893943123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X....................X.......X.X....] duration:
5.772958026s
FAIL (2025-08-14 16:01:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:59:00.940611035 (142h32m55.371691206s) [upload=148269]: Starting upload
Aug 14 15:59:00.940672101 (142h32m55.371752232s) [upload=148269]: Done starting upload
Aug 14 15:59:00.940742666 (142h32m55.371822797s) [upload=148269]: Uploading segments...
Aug 14 15:59:00.940875069 (142h32m55.3719552s) [upload=148269]: Got next segment. Inline: false
Aug 14 15:59:00.940922891 (142h32m55.372003022s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:59:00.940942639 (142h32m55.37202276s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:59:01.393210479 (142h32m55.8242906s) [seg_pos={0 0}, upload=148269]: Begin upload segment...
Aug 14 15:59:01.393260515 (142h32m55.824340646s) [seg_pos={0 0}, upload=148269]: Done begin upload segment.
Aug 14 15:59:01.393290742 (142h32m55.824370873s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.393334756 (142h32m55.824414887s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394525445 (142h32m55.825605576s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394652357 (142h32m55.825732488s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395540657 (142h32m55.826620788s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395740549 (142h32m55.82682068s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396612598 (142h32m55.827692729s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396870842 (142h32m55.827950973s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.397722962 (142h32m55.828803093s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.399063668 (142h32m55.830143799s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.400967361 (142h32m55.832047492s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.401868124 (142h32m55.832948255s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406095342 (142h32m55.837175473s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406384435 (142h32m55.837464566s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406624755 (142h32m55.837704886s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406876707 (142h32m55.837956838s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407131615 (142h32m55.838211746s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407384618 (142h32m55.83846475s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:02.612618539 (142h32m57.04369867s) [upload=148269]: Next returned nil segment
Aug 14 15:59:02.612635281 (142h32m57.043715412s) [upload=148269]: Waiting for error group managing segments...
Aug 14 15:59:02.923156547 (142h32m57.354236678s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.240988870 (142h32m57.672069002s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.311740886 (142h32m57.742821017s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.328045995 (142h32m57.759126176s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.337482150 (142h32m57.768562271s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.364603913 (142h32m57.795684044s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.387498330 (142h32m57.818578461s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.396737096 (142h32m57.827817227s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.429049653 (142h32m57.860129774s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.478715342 (142h32m57.909795473s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.508864559 (142h32m57.93994469s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.572843184 (142h32m58.003923315s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.645968161 (142h32m58.077048292s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793169633 (142h32m58.224249764s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793195582 (142h32m58.224275703s) [seg_pos={0 0}, upload=148269]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:59:03.793305904 (142h32m58.224386035s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF
Aug 14 15:59:03.793585949 (142h32m58.22466608s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: write tcp 188.166.225.170:51042->104.36.82.23:4466: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793642117 (142h32m58.224722248s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: read tcp 188.166.225.170:49416->104.36.82.8:4978: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793665251 (142h32m58.224745382s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mLiUHc5wogTx5spRu3aNfAh35g31kwXbEfn5aCJoHXUVDkhGU): protocol: read tcp 188.166.225.170:43010->104.36.82.38:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793689858 (142h32m58.224769989s) [seg_pos={0 0}, upload=148269]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:59:03.793775111 (142h32m58.224855242s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:59:03.793779640 (142h32m58.224859771s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:59:04.108039459 (142h32m58.53911958s) [upload=148269]: Done uploading segments...
Aug 14 15:59:04.108056641 (142h32m58.539136772s) [upload=148269]: Upload finished. err: <nil>
Duration: 5.772986159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.......X.......X.....................................X..] duration:
1.932796245s
FAIL (2025-08-14 16:01:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.932821142s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X....................X.......X.X...] duration:
6.099751596s
FAIL (2025-08-14 16:01:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:59:00.940611035 (142h32m55.371691206s) [upload=148269]: Starting upload
Aug 14 15:59:00.940672101 (142h32m55.371752232s) [upload=148269]: Done starting upload
Aug 14 15:59:00.940742666 (142h32m55.371822797s) [upload=148269]: Uploading segments...
Aug 14 15:59:00.940875069 (142h32m55.3719552s) [upload=148269]: Got next segment. Inline: false
Aug 14 15:59:00.940922891 (142h32m55.372003022s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:59:00.940942639 (142h32m55.37202276s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:59:01.393210479 (142h32m55.8242906s) [seg_pos={0 0}, upload=148269]: Begin upload segment...
Aug 14 15:59:01.393260515 (142h32m55.824340646s) [seg_pos={0 0}, upload=148269]: Done begin upload segment.
Aug 14 15:59:01.393290742 (142h32m55.824370873s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.393334756 (142h32m55.824414887s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394525445 (142h32m55.825605576s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394652357 (142h32m55.825732488s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395540657 (142h32m55.826620788s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395740549 (142h32m55.82682068s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396612598 (142h32m55.827692729s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396870842 (142h32m55.827950973s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.397722962 (142h32m55.828803093s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.399063668 (142h32m55.830143799s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.400967361 (142h32m55.832047492s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.401868124 (142h32m55.832948255s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406095342 (142h32m55.837175473s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406384435 (142h32m55.837464566s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406624755 (142h32m55.837704886s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406876707 (142h32m55.837956838s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407131615 (142h32m55.838211746s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407384618 (142h32m55.83846475s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:02.612618539 (142h32m57.04369867s) [upload=148269]: Next returned nil segment
Aug 14 15:59:02.612635281 (142h32m57.043715412s) [upload=148269]: Waiting for error group managing segments...
Aug 14 15:59:02.923156547 (142h32m57.354236678s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.240988870 (142h32m57.672069002s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.311740886 (142h32m57.742821017s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.328045995 (142h32m57.759126176s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.337482150 (142h32m57.768562271s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.364603913 (142h32m57.795684044s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.387498330 (142h32m57.818578461s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.396737096 (142h32m57.827817227s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.429049653 (142h32m57.860129774s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.478715342 (142h32m57.909795473s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.508864559 (142h32m57.93994469s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.572843184 (142h32m58.003923315s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.645968161 (142h32m58.077048292s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793169633 (142h32m58.224249764s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793195582 (142h32m58.224275703s) [seg_pos={0 0}, upload=148269]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:59:03.793305904 (142h32m58.224386035s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF
Aug 14 15:59:03.793585949 (142h32m58.22466608s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: write tcp 188.166.225.170:51042->104.36.82.23:4466: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793642117 (142h32m58.224722248s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: read tcp 188.166.225.170:49416->104.36.82.8:4978: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793665251 (142h32m58.224745382s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mLiUHc5wogTx5spRu3aNfAh35g31kwXbEfn5aCJoHXUVDkhGU): protocol: read tcp 188.166.225.170:43010->104.36.82.38:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793689858 (142h32m58.224769989s) [seg_pos={0 0}, upload=148269]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:59:03.793775111 (142h32m58.224855242s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:59:03.793779640 (142h32m58.224859771s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:59:04.108039459 (142h32m58.53911958s) [upload=148269]: Done uploading segments...
Aug 14 15:59:04.108056641 (142h32m58.539136772s) [upload=148269]: Upload finished. err: <nil>
Duration: 6.099778959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.......X.......X.....................................X.] duration:
1.948274631s
FAIL (2025-08-14 16:01:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.948302395s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.......X.......X.....................................X] duration:
864.902899ms
FAIL (2025-08-14 16:00:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 16:00:22.936573054 (142h34m17.367653186s) [upload=148292]: Starting upload Aug 14 16:00:22.936651104 (142h34m17.367731235s) [upload=148292]: Done starting upload Aug 14 16:00:22.936723051 (142h34m17.367803192s) [upload=148292]: Uploading segments... Aug 14 16:00:22.936770432 (142h34m17.367850583s) [upload=148292]: Got next segment. Inline: true Aug 14 16:00:22.936776493 (142h34m17.367856634s) [upload=148292]: Waiting for error group managing segments... Aug 14 16:00:22.936827391 (142h34m17.367907522s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 16:00:22.936834083 (142h34m17.367914214s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 16:00:22.936837470 (142h34m17.367917601s) [upload=148292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 16:00:23.151437972 (142h34m17.582518103s) [upload=148292]: Done uploading segments... Aug 14 16:00:23.151455145 (142h34m17.582535276s) [upload=148292]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.918969ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X....................X.......X.X..] duration:
6.17470143s
FAIL (2025-08-14 16:00:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:59:00.940611035 (142h32m55.371691206s) [upload=148269]: Starting upload
Aug 14 15:59:00.940672101 (142h32m55.371752232s) [upload=148269]: Done starting upload
Aug 14 15:59:00.940742666 (142h32m55.371822797s) [upload=148269]: Uploading segments...
Aug 14 15:59:00.940875069 (142h32m55.3719552s) [upload=148269]: Got next segment. Inline: false
Aug 14 15:59:00.940922891 (142h32m55.372003022s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:59:00.940942639 (142h32m55.37202276s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:59:01.393210479 (142h32m55.8242906s) [seg_pos={0 0}, upload=148269]: Begin upload segment...
Aug 14 15:59:01.393260515 (142h32m55.824340646s) [seg_pos={0 0}, upload=148269]: Done begin upload segment.
Aug 14 15:59:01.393290742 (142h32m55.824370873s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.393334756 (142h32m55.824414887s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394525445 (142h32m55.825605576s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394652357 (142h32m55.825732488s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395540657 (142h32m55.826620788s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395740549 (142h32m55.82682068s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396612598 (142h32m55.827692729s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396870842 (142h32m55.827950973s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.397722962 (142h32m55.828803093s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.399063668 (142h32m55.830143799s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.400967361 (142h32m55.832047492s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.401868124 (142h32m55.832948255s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406095342 (142h32m55.837175473s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406384435 (142h32m55.837464566s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406624755 (142h32m55.837704886s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406876707 (142h32m55.837956838s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407131615 (142h32m55.838211746s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407384618 (142h32m55.83846475s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:02.612618539 (142h32m57.04369867s) [upload=148269]: Next returned nil segment
Aug 14 15:59:02.612635281 (142h32m57.043715412s) [upload=148269]: Waiting for error group managing segments...
Aug 14 15:59:02.923156547 (142h32m57.354236678s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.240988870 (142h32m57.672069002s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.311740886 (142h32m57.742821017s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.328045995 (142h32m57.759126176s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.337482150 (142h32m57.768562271s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.364603913 (142h32m57.795684044s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.387498330 (142h32m57.818578461s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.396737096 (142h32m57.827817227s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.429049653 (142h32m57.860129774s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.478715342 (142h32m57.909795473s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.508864559 (142h32m57.93994469s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.572843184 (142h32m58.003923315s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.645968161 (142h32m58.077048292s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793169633 (142h32m58.224249764s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793195582 (142h32m58.224275703s) [seg_pos={0 0}, upload=148269]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:59:03.793305904 (142h32m58.224386035s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF
Aug 14 15:59:03.793585949 (142h32m58.22466608s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: write tcp 188.166.225.170:51042->104.36.82.23:4466: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793642117 (142h32m58.224722248s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: read tcp 188.166.225.170:49416->104.36.82.8:4978: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793665251 (142h32m58.224745382s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mLiUHc5wogTx5spRu3aNfAh35g31kwXbEfn5aCJoHXUVDkhGU): protocol: read tcp 188.166.225.170:43010->104.36.82.38:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793689858 (142h32m58.224769989s) [seg_pos={0 0}, upload=148269]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:59:03.793775111 (142h32m58.224855242s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:59:03.793779640 (142h32m58.224859771s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:59:04.108039459 (142h32m58.53911958s) [upload=148269]: Done uploading segments...
Aug 14 15:59:04.108056641 (142h32m58.539136772s) [upload=148269]: Upload finished. err: <nil>
Duration: 6.174733542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X....................X.......X.X.] duration:
6.436243307s
FAIL (2025-08-14 15:59:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:59:00.940611035 (142h32m55.371691206s) [upload=148269]: Starting upload
Aug 14 15:59:00.940672101 (142h32m55.371752232s) [upload=148269]: Done starting upload
Aug 14 15:59:00.940742666 (142h32m55.371822797s) [upload=148269]: Uploading segments...
Aug 14 15:59:00.940875069 (142h32m55.3719552s) [upload=148269]: Got next segment. Inline: false
Aug 14 15:59:00.940922891 (142h32m55.372003022s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:59:00.940942639 (142h32m55.37202276s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:59:01.393210479 (142h32m55.8242906s) [seg_pos={0 0}, upload=148269]: Begin upload segment...
Aug 14 15:59:01.393260515 (142h32m55.824340646s) [seg_pos={0 0}, upload=148269]: Done begin upload segment.
Aug 14 15:59:01.393290742 (142h32m55.824370873s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.393334756 (142h32m55.824414887s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394525445 (142h32m55.825605576s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394652357 (142h32m55.825732488s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395540657 (142h32m55.826620788s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395740549 (142h32m55.82682068s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396612598 (142h32m55.827692729s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396870842 (142h32m55.827950973s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.397722962 (142h32m55.828803093s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.399063668 (142h32m55.830143799s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.400967361 (142h32m55.832047492s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.401868124 (142h32m55.832948255s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406095342 (142h32m55.837175473s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406384435 (142h32m55.837464566s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406624755 (142h32m55.837704886s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406876707 (142h32m55.837956838s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407131615 (142h32m55.838211746s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407384618 (142h32m55.83846475s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:02.612618539 (142h32m57.04369867s) [upload=148269]: Next returned nil segment
Aug 14 15:59:02.612635281 (142h32m57.043715412s) [upload=148269]: Waiting for error group managing segments...
Aug 14 15:59:02.923156547 (142h32m57.354236678s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.240988870 (142h32m57.672069002s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.311740886 (142h32m57.742821017s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.328045995 (142h32m57.759126176s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.337482150 (142h32m57.768562271s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.364603913 (142h32m57.795684044s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.387498330 (142h32m57.818578461s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.396737096 (142h32m57.827817227s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.429049653 (142h32m57.860129774s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.478715342 (142h32m57.909795473s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.508864559 (142h32m57.93994469s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.572843184 (142h32m58.003923315s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.645968161 (142h32m58.077048292s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793169633 (142h32m58.224249764s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793195582 (142h32m58.224275703s) [seg_pos={0 0}, upload=148269]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:59:03.793305904 (142h32m58.224386035s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF
Aug 14 15:59:03.793585949 (142h32m58.22466608s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: write tcp 188.166.225.170:51042->104.36.82.23:4466: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793642117 (142h32m58.224722248s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: read tcp 188.166.225.170:49416->104.36.82.8:4978: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793665251 (142h32m58.224745382s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mLiUHc5wogTx5spRu3aNfAh35g31kwXbEfn5aCJoHXUVDkhGU): protocol: read tcp 188.166.225.170:43010->104.36.82.38:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793689858 (142h32m58.224769989s) [seg_pos={0 0}, upload=148269]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:59:03.793775111 (142h32m58.224855242s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:59:03.793779640 (142h32m58.224859771s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:59:04.108039459 (142h32m58.53911958s) [upload=148269]: Done uploading segments...
Aug 14 15:59:04.108056641 (142h32m58.539136772s) [upload=148269]: Upload finished. err: <nil>
Duration: 6.436269717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.....X.......X.......X.....................................] duration:
1.87876474s
FAIL (2025-08-14 15:59:29 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 15:31:50.473046898 (142h5m44.904127029s) [upload=147807]: Starting upload Aug 14 15:31:50.473091744 (142h5m44.904171865s) [upload=147807]: Done starting upload Aug 14 15:31:50.473145377 (142h5m44.904225498s) [upload=147807]: Uploading segments... Aug 14 15:31:50.473193288 (142h5m44.90427341s) [upload=147807]: Got next segment. Inline: true Aug 14 15:31:50.473197256 (142h5m44.904277387s) [upload=147807]: Waiting for error group managing segments... Aug 14 15:31:50.473228095 (142h5m44.904308226s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:31:50.473232022 (142h5m44.904312153s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:31:50.473234577 (142h5m44.904314698s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:31:55.112783721 (142h5m49.543863852s) [upload=147807]: Done uploading segments... Aug 14 15:31:55.112802908 (142h5m49.543883039s) [upload=147807]: Upload finished. err: <nil>
Duration: 1.878802302s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X....................X.......X.X] duration:
4.478177757s
FAIL (2025-08-14 15:59:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:59:00.940611035 (142h32m55.371691206s) [upload=148269]: Starting upload
Aug 14 15:59:00.940672101 (142h32m55.371752232s) [upload=148269]: Done starting upload
Aug 14 15:59:00.940742666 (142h32m55.371822797s) [upload=148269]: Uploading segments...
Aug 14 15:59:00.940875069 (142h32m55.3719552s) [upload=148269]: Got next segment. Inline: false
Aug 14 15:59:00.940922891 (142h32m55.372003022s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:59:00.940942639 (142h32m55.37202276s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:59:01.393210479 (142h32m55.8242906s) [seg_pos={0 0}, upload=148269]: Begin upload segment...
Aug 14 15:59:01.393260515 (142h32m55.824340646s) [seg_pos={0 0}, upload=148269]: Done begin upload segment.
Aug 14 15:59:01.393290742 (142h32m55.824370873s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.393334756 (142h32m55.824414887s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394525445 (142h32m55.825605576s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.394652357 (142h32m55.825732488s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395540657 (142h32m55.826620788s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.395740549 (142h32m55.82682068s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396612598 (142h32m55.827692729s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.396870842 (142h32m55.827950973s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.397722962 (142h32m55.828803093s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.399063668 (142h32m55.830143799s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.400967361 (142h32m55.832047492s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.401868124 (142h32m55.832948255s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406095342 (142h32m55.837175473s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406384435 (142h32m55.837464566s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406624755 (142h32m55.837704886s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.406876707 (142h32m55.837956838s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407131615 (142h32m55.838211746s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:01.407384618 (142h32m55.83846475s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Uploading piece...
Aug 14 15:59:02.612618539 (142h32m57.04369867s) [upload=148269]: Next returned nil segment
Aug 14 15:59:02.612635281 (142h32m57.043715412s) [upload=148269]: Waiting for error group managing segments...
Aug 14 15:59:02.923156547 (142h32m57.354236678s) [noise=true , address=66.23.193.175:4560 , piece_id=KY5WZRCFQSM644C2C2B4CMICYDFAPHQR2O3EAMDKRVATNVLXVVZQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.240988870 (142h32m57.672069002s) [noise=true , address=79.127.220.101:4074 , piece_id=QQHTFRFX55DJDZCKL6M26QQFVW464IL5VESKSWL7CDRLNKHDGKUQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.311740886 (142h32m57.742821017s) [noise=true , address=77.90.31.16:4741 , piece_id=5JKYYAGH5X4J7Q2YIT4DZZSUKWG6JHGSFCDOUNCNN236CML7DTEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.328045995 (142h32m57.759126176s) [noise=true , address=104.36.82.39:4731 , piece_id=K4FZ4ZCPWFZKJBYS2RUM4ZUJORSIM5MPJWFNKYFIJH3IASCZB64Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.337482150 (142h32m57.768562271s) [noise=true , address=104.36.82.17:4361 , piece_id=TN5FVDSCCJ7E7K43FBUZNXHXWJZTQUMFPSYJVL5SPC3JH23F6H5Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.364603913 (142h32m57.795684044s) [noise=true , address=104.36.82.5:4843 , piece_id=MGEO6F5QHCQMLO3JCXLYIBWO7L6AKSYYID2H25YBSG3XXSKICCPQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.387498330 (142h32m57.818578461s) [noise=true , address=104.36.82.37:4675 , piece_id=THEQXYGDZE3BPTM3OVT3RJU7IW32EQN67OVNQF634SAA4DNNIFEA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.396737096 (142h32m57.827817227s) [noise=true , address=104.36.82.22:4509 , piece_id=M6X7EPM4ATCI4OD6Z4UI7VA7N65DKMTDAXCOPI6ZH7ESTEDYHU5A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.429049653 (142h32m57.860129774s) [noise=true , address=104.36.82.36:4643 , piece_id=MJMZBKEECC7FB2WIWEAAMYC6WDES24HCDLZK65UF4U2RFVJ6IHWQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.478715342 (142h32m57.909795473s) [noise=true , address=104.36.82.16:4301 , piece_id=HLT5XA6I7B22IBRZQVSGXAB7YB2V5JX3LM26VTM7FWR672XCZANA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.508864559 (142h32m57.93994469s) [noise=true , address=104.36.82.10:4110 , piece_id=B3WJT7QJJN6UWQSEEYF6LTKUETPS5JVXF5C5G4L2ZCL32H7Y5K6A, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.572843184 (142h32m58.003923315s) [noise=true , address=77.90.31.11:4578 , piece_id=DQKIXV3XS5RYCFRWJOINPRYY5LSVODEZF4DBEPHYXRW36HYFKWGA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.645968161 (142h32m58.077048292s) [noise=true , address=77.90.31.10:4528 , piece_id=OAJVJB42G5KJFM7XOIVTREW4O7Q573GWE3336NCSGBV6AIBPYPBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793169633 (142h32m58.224249764s) [noise=true , address=104.36.82.44:4876 , piece_id=OFUAMQZ3UODVHY4NPUV6XO3O56ZWUGAM34M4HAYEXDK4CUWZCFRA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: <nil>
Aug 14 15:59:03.793195582 (142h32m58.224275703s) [seg_pos={0 0}, upload=148269]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:59:03.793305904 (142h32m58.224386035s) [noise=true , address=104.36.82.60:4346 , piece_id=KLZ6NRYOHFVPLRGSALMLOBYLAU7KJFFGQFUYOTBQ6VZ7DY3NVVBA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HohFM5Npi28Xq65JVMGUDK2bfX7xh5uYXNeHs3XW2VRH8rS72): protocol: expected piece hash; context canceled; EOF
Aug 14 15:59:03.793585949 (142h32m58.22466608s) [noise=true , address=104.36.82.23:4466 , piece_id=6LROKB3ZWH7HCIXGLBLZCBQIB6ONZT3NUAS47SPHDWRSOZGG327Q, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rkNnk9RUhKBJ3EsakqMRb3wYwrhRLhB4ZYbrdfKPDk8erRJpP): protocol: write tcp 188.166.225.170:51042->104.36.82.23:4466: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793642117 (142h32m58.224722248s) [noise=true , address=104.36.82.8:4978 , piece_id=MLYZ6LVETEGJCZY5MYPWRLGERSFU76QVGM6DM7SCM4W3EKVAXXXA, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124urtaxr9hWQSs1Kik6Npue6EaRhaUMjEo8UHJSbz6HWaEFWCX): protocol: read tcp 188.166.225.170:49416->104.36.82.8:4978: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793665251 (142h32m58.224745382s) [noise=true , address=104.36.82.38:4697 , piece_id=P5QWWJCAGITYCGBWWUYVFLRW53IBNFZDCSBV74Z43U5NGIIT4ZYQ, seg_pos={0 0}, upload=148269]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mLiUHc5wogTx5spRu3aNfAh35g31kwXbEfn5aCJoHXUVDkhGU): protocol: read tcp 188.166.225.170:43010->104.36.82.38:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:59:03.793689858 (142h32m58.224769989s) [seg_pos={0 0}, upload=148269]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:59:03.793775111 (142h32m58.224855242s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:59:03.793779640 (142h32m58.224859771s) [upload=148269]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:59:04.108039459 (142h32m58.53911958s) [upload=148269]: Done uploading segments...
Aug 14 15:59:04.108056641 (142h32m58.539136772s) [upload=148269]: Upload finished. err: <nil>
Duration: 4.478204738s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [XX.....X.......X.......X....................................] duration:
1.955976636s
FAIL (2025-08-14 15:58:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 15:31:50.473046898 (142h5m44.904127029s) [upload=147807]: Starting upload Aug 14 15:31:50.473091744 (142h5m44.904171865s) [upload=147807]: Done starting upload Aug 14 15:31:50.473145377 (142h5m44.904225498s) [upload=147807]: Uploading segments... Aug 14 15:31:50.473193288 (142h5m44.90427341s) [upload=147807]: Got next segment. Inline: true Aug 14 15:31:50.473197256 (142h5m44.904277387s) [upload=147807]: Waiting for error group managing segments... Aug 14 15:31:50.473228095 (142h5m44.904308226s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:31:50.473232022 (142h5m44.904312153s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:31:50.473234577 (142h5m44.904314698s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:31:55.112783721 (142h5m49.543863852s) [upload=147807]: Done uploading segments... Aug 14 15:31:55.112802908 (142h5m49.543883039s) [upload=147807]: Upload finished. err: <nil>
Duration: 1.956030731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................X....................X.......X.] duration:
6.045416931s
FAIL (2025-08-14 15:58:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:58:05.120820303 (142h31m59.551900434s) [upload=148250]: Starting upload
Aug 14 15:58:05.120867672 (142h31m59.551947804s) [upload=148250]: Done starting upload
Aug 14 15:58:05.120930323 (142h31m59.552010454s) [upload=148250]: Uploading segments...
Aug 14 15:58:05.121048779 (142h31m59.55212891s) [upload=148250]: Got next segment. Inline: false
Aug 14 15:58:05.121086581 (142h31m59.552166712s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:58:05.121090941 (142h31m59.552171072s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:58:05.574282859 (142h32m0.00536299s) [seg_pos={0 0}, upload=148250]: Begin upload segment...
Aug 14 15:58:05.574319619 (142h32m0.00539975s) [seg_pos={0 0}, upload=148250]: Done begin upload segment.
Aug 14 15:58:05.574340288 (142h32m0.005420419s) [noise=true , address=104.36.82.59:4312 , piece_id=4CAPF76G6TQKMDYPI3BLTW3UQH2OJ3DU7FE45YIGOVXHU4I54SMA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.574693084 (142h32m0.005773215s) [noise=true , address=104.36.82.4:4823 , piece_id=Q3AE5UGUAYYZ5XDGQMGDOS5GGHJSKWHPPR6YSRIZUPCY3FYX4K4A, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.574944615 (142h32m0.006024746s) [noise=true , address=79.127.201.215:4350 , piece_id=MN2LO6GJUAVZYBZ3A6HWIMJPWHH5XLR2FJ6ZQGYIMBKEJE4IXVWA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575200935 (142h32m0.006281066s) [noise=true , address=104.36.82.35:4613 , piece_id=FQ46Z6MPBW2DKSXIHZCEJNJ62I3XDFX2ENLOSE2CHLYWCGNOUWCQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575462315 (142h32m0.006542446s) [noise=true , address=77.90.31.11:4565 , piece_id=2NBQMKGMONVNCQMOTOB4KFX6Y4OYHQRBFKRY6EOLFDXRY5PP6IWQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575719377 (142h32m0.006799498s) [noise=true , address=104.36.82.34:4556 , piece_id=VTTA4SLPRXOUUBDJ4D72VKH4ND55N32S526SWVJD5GYQEZCZMKHQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575978804 (142h32m0.007058935s) [noise=true , address=104.36.82.5:4860 , piece_id=5PMETX2VB2HJECFLY6ROCHESTAUXVK6FDRCBGMLFZDIBBAXH242Q, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576168867 (142h32m0.007248988s) [noise=true , address=66.23.193.175:4563 , piece_id=5DNK36NIVJGARKWXRSO6OLXEAO3QL4ZVVHK5Q7CG7O5GVX2ZXTTA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576432291 (142h32m0.007512422s) [noise=true , address=104.36.82.8:4001 , piece_id=YYE63QJSZFB6O43EAOMJV3C3XBPJBNK77M6UKAVXDVCVPIZJ4IPQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576813070 (142h32m0.007893201s) [noise=true , address=77.90.31.16:4741 , piece_id=XWKKYRNV5MIBFF5YNBK23QTPGWYM2DZQI4MCFD5RWK5LN3RY2W2A, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577048430 (142h32m0.008128551s) [noise=true , address=77.90.31.19:4849 , piece_id=FMOJA25VSHTHT7GZUXKNULKGYY3RHOD2AVMEQAD5K25VZC667OIA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577244065 (142h32m0.008324196s) [noise=true , address=77.90.31.15:4724 , piece_id=PIZNAOUCMI2HCWGSLWS4JYDIDDSVZNHIVRQTZS2CR7WZ7BPYAOVA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577432475 (142h32m0.008512606s) [noise=true , address=104.36.82.36:4637 , piece_id=BIKBTGI3BAMHNWUC34LS64XN7OULI3D54BX6RGEYJUCCZZOTQYZQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577618861 (142h32m0.008698992s) [noise=true , address=104.36.82.60:4372 , piece_id=ZIPW5JETCNLLYHN4ETZKFUHHG65LGL6EN5GPKY74OHQTB6SXKTIQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577836548 (142h32m0.008916679s) [noise=true , address=77.90.31.12:4607 , piece_id=K3YPCDXXW3T6IPIELXWSIHY6PLEPRTEKNGPX5HFWFQBRWN53WKHQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578034237 (142h32m0.009114368s) [noise=true , address=104.36.82.23:4469 , piece_id=36BCS3GUJDZHVRLZEQXNJUQ357QNSNFDPDCOFOA6GXOC6UFR7ZVQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578213589 (142h32m0.00929372s) [noise=true , address=77.90.31.18:4836 , piece_id=7TTFRT2ZLM3RAPVNLMSO5SGNFFJBZT5ABLAD4RP7RT4CVBG6R6DA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578400677 (142h32m0.009480808s) [noise=true , address=77.90.31.21:4894 , piece_id=TXKMA72IVJ35RLNPDFGDGI7PZUKAONRYFGCFWRAKX3IV3LW6XKPA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:06.700651660 (142h32m1.131731791s) [upload=148250]: Next returned nil segment
Aug 14 15:58:06.700667500 (142h32m1.131747631s) [upload=148250]: Waiting for error group managing segments...
Aug 14 15:58:06.983878641 (142h32m1.414958772s) [noise=true , address=66.23.193.175:4563 , piece_id=5DNK36NIVJGARKWXRSO6OLXEAO3QL4ZVVHK5Q7CG7O5GVX2ZXTTA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.509408950 (142h32m1.940489071s) [noise=true , address=79.127.201.215:4350 , piece_id=MN2LO6GJUAVZYBZ3A6HWIMJPWHH5XLR2FJ6ZQGYIMBKEJE4IXVWA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.584144688 (142h32m2.015224819s) [noise=true , address=104.36.82.36:4637 , piece_id=BIKBTGI3BAMHNWUC34LS64XN7OULI3D54BX6RGEYJUCCZZOTQYZQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.616107745 (142h32m2.047187876s) [noise=true , address=104.36.82.59:4312 , piece_id=4CAPF76G6TQKMDYPI3BLTW3UQH2OJ3DU7FE45YIGOVXHU4I54SMA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.678989211 (142h32m2.110069343s) [noise=true , address=104.36.82.8:4001 , piece_id=YYE63QJSZFB6O43EAOMJV3C3XBPJBNK77M6UKAVXDVCVPIZJ4IPQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.680052216 (142h32m2.111132347s) [noise=true , address=77.90.31.16:4741 , piece_id=XWKKYRNV5MIBFF5YNBK23QTPGWYM2DZQI4MCFD5RWK5LN3RY2W2A, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.681533168 (142h32m2.112613289s) [noise=true , address=77.90.31.11:4565 , piece_id=2NBQMKGMONVNCQMOTOB4KFX6Y4OYHQRBFKRY6EOLFDXRY5PP6IWQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.687149425 (142h32m2.118229556s) [noise=true , address=77.90.31.15:4724 , piece_id=PIZNAOUCMI2HCWGSLWS4JYDIDDSVZNHIVRQTZS2CR7WZ7BPYAOVA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.750021633 (142h32m2.181101765s) [noise=true , address=77.90.31.19:4849 , piece_id=FMOJA25VSHTHT7GZUXKNULKGYY3RHOD2AVMEQAD5K25VZC667OIA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.758053882 (142h32m2.189134013s) [noise=true , address=77.90.31.12:4607 , piece_id=K3YPCDXXW3T6IPIELXWSIHY6PLEPRTEKNGPX5HFWFQBRWN53WKHQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.767592053 (142h32m2.198672184s) [noise=true , address=77.90.31.21:4894 , piece_id=TXKMA72IVJ35RLNPDFGDGI7PZUKAONRYFGCFWRAKX3IV3LW6XKPA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.781512538 (142h32m2.212592669s) [noise=true , address=77.90.31.18:4836 , piece_id=7TTFRT2ZLM3RAPVNLMSO5SGNFFJBZT5ABLAD4RP7RT4CVBG6R6DA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.866054669 (142h32m2.297134801s) [noise=true , address=104.36.82.4:4823 , piece_id=Q3AE5UGUAYYZ5XDGQMGDOS5GGHJSKWHPPR6YSRIZUPCY3FYX4K4A, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:09.058161132 (142h32m3.489241263s) [noise=true , address=104.36.82.34:4556 , piece_id=VTTA4SLPRXOUUBDJ4D72VKH4ND55N32S526SWVJD5GYQEZCZMKHQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:09.058187202 (142h32m3.489267333s) [seg_pos={0 0}, upload=148250]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:58:09.058441549 (142h32m3.48952168s) [noise=true , address=104.36.82.35:4613 , piece_id=FQ46Z6MPBW2DKSXIHZCEJNJ62I3XDFX2ENLOSE2CHLYWCGNOUWCQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xjm7XPPwM9nXBP3SS36HeLNxBVJdEpcQyD9BAp79xbGCze4vL): protocol: expected piece hash; context canceled; EOF
Aug 14 15:58:09.058462429 (142h32m3.48954256s) [noise=true , address=104.36.82.5:4860 , piece_id=5PMETX2VB2HJECFLY6ROCHESTAUXVK6FDRCBGMLFZDIBBAXH242Q, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection; write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection
Aug 14 15:58:09.058512084 (142h32m3.489592215s) [noise=true , address=104.36.82.23:4469 , piece_id=36BCS3GUJDZHVRLZEQXNJUQ357QNSNFDPDCOFOA6GXOC6UFR7ZVQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: read tcp 188.166.225.170:38284->104.36.82.23:4469: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:58:09.058523706 (142h32m3.489603837s) [noise=true , address=104.36.82.60:4372 , piece_id=ZIPW5JETCNLLYHN4ETZKFUHHG65LGL6EN5GPKY74OHQTB6SXKTIQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kJnsSPzFa7JwUMHuvosMmFrGvQ8tCsQbjwWdxbqjHNHgTfaL3): protocol: expected piece hash; context canceled; EOF
Aug 14 15:58:09.058538414 (142h32m3.489618545s) [seg_pos={0 0}, upload=148250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:58:09.058617446 (142h32m3.489697577s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:58:09.058621624 (142h32m3.489701755s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:58:09.385842712 (142h32m3.816922843s) [upload=148250]: Done uploading segments...
Aug 14 15:58:09.385860636 (142h32m3.816940757s) [upload=148250]: Upload finished. err: <nil>
Duration: 6.045441698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.XX.....X.......X.......X...................................] duration:
1.868405058s
FAIL (2025-08-14 15:58:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 15:31:50.473046898 (142h5m44.904127029s) [upload=147807]: Starting upload Aug 14 15:31:50.473091744 (142h5m44.904171865s) [upload=147807]: Done starting upload Aug 14 15:31:50.473145377 (142h5m44.904225498s) [upload=147807]: Uploading segments... Aug 14 15:31:50.473193288 (142h5m44.90427341s) [upload=147807]: Got next segment. Inline: true Aug 14 15:31:50.473197256 (142h5m44.904277387s) [upload=147807]: Waiting for error group managing segments... Aug 14 15:31:50.473228095 (142h5m44.904308226s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:31:50.473232022 (142h5m44.904312153s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:31:50.473234577 (142h5m44.904314698s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:31:55.112783721 (142h5m49.543863852s) [upload=147807]: Done uploading segments... Aug 14 15:31:55.112802908 (142h5m49.543883039s) [upload=147807]: Upload finished. err: <nil>
Duration: 1.868437871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X....................X.......X] duration:
5.584743057s
FAIL (2025-08-14 15:58:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 15:58:05.120820303 (142h31m59.551900434s) [upload=148250]: Starting upload
Aug 14 15:58:05.120867672 (142h31m59.551947804s) [upload=148250]: Done starting upload
Aug 14 15:58:05.120930323 (142h31m59.552010454s) [upload=148250]: Uploading segments...
Aug 14 15:58:05.121048779 (142h31m59.55212891s) [upload=148250]: Got next segment. Inline: false
Aug 14 15:58:05.121086581 (142h31m59.552166712s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:58:05.121090941 (142h31m59.552171072s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:58:05.574282859 (142h32m0.00536299s) [seg_pos={0 0}, upload=148250]: Begin upload segment...
Aug 14 15:58:05.574319619 (142h32m0.00539975s) [seg_pos={0 0}, upload=148250]: Done begin upload segment.
Aug 14 15:58:05.574340288 (142h32m0.005420419s) [noise=true , address=104.36.82.59:4312 , piece_id=4CAPF76G6TQKMDYPI3BLTW3UQH2OJ3DU7FE45YIGOVXHU4I54SMA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.574693084 (142h32m0.005773215s) [noise=true , address=104.36.82.4:4823 , piece_id=Q3AE5UGUAYYZ5XDGQMGDOS5GGHJSKWHPPR6YSRIZUPCY3FYX4K4A, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.574944615 (142h32m0.006024746s) [noise=true , address=79.127.201.215:4350 , piece_id=MN2LO6GJUAVZYBZ3A6HWIMJPWHH5XLR2FJ6ZQGYIMBKEJE4IXVWA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575200935 (142h32m0.006281066s) [noise=true , address=104.36.82.35:4613 , piece_id=FQ46Z6MPBW2DKSXIHZCEJNJ62I3XDFX2ENLOSE2CHLYWCGNOUWCQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575462315 (142h32m0.006542446s) [noise=true , address=77.90.31.11:4565 , piece_id=2NBQMKGMONVNCQMOTOB4KFX6Y4OYHQRBFKRY6EOLFDXRY5PP6IWQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575719377 (142h32m0.006799498s) [noise=true , address=104.36.82.34:4556 , piece_id=VTTA4SLPRXOUUBDJ4D72VKH4ND55N32S526SWVJD5GYQEZCZMKHQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.575978804 (142h32m0.007058935s) [noise=true , address=104.36.82.5:4860 , piece_id=5PMETX2VB2HJECFLY6ROCHESTAUXVK6FDRCBGMLFZDIBBAXH242Q, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576168867 (142h32m0.007248988s) [noise=true , address=66.23.193.175:4563 , piece_id=5DNK36NIVJGARKWXRSO6OLXEAO3QL4ZVVHK5Q7CG7O5GVX2ZXTTA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576432291 (142h32m0.007512422s) [noise=true , address=104.36.82.8:4001 , piece_id=YYE63QJSZFB6O43EAOMJV3C3XBPJBNK77M6UKAVXDVCVPIZJ4IPQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.576813070 (142h32m0.007893201s) [noise=true , address=77.90.31.16:4741 , piece_id=XWKKYRNV5MIBFF5YNBK23QTPGWYM2DZQI4MCFD5RWK5LN3RY2W2A, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577048430 (142h32m0.008128551s) [noise=true , address=77.90.31.19:4849 , piece_id=FMOJA25VSHTHT7GZUXKNULKGYY3RHOD2AVMEQAD5K25VZC667OIA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577244065 (142h32m0.008324196s) [noise=true , address=77.90.31.15:4724 , piece_id=PIZNAOUCMI2HCWGSLWS4JYDIDDSVZNHIVRQTZS2CR7WZ7BPYAOVA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577432475 (142h32m0.008512606s) [noise=true , address=104.36.82.36:4637 , piece_id=BIKBTGI3BAMHNWUC34LS64XN7OULI3D54BX6RGEYJUCCZZOTQYZQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577618861 (142h32m0.008698992s) [noise=true , address=104.36.82.60:4372 , piece_id=ZIPW5JETCNLLYHN4ETZKFUHHG65LGL6EN5GPKY74OHQTB6SXKTIQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.577836548 (142h32m0.008916679s) [noise=true , address=77.90.31.12:4607 , piece_id=K3YPCDXXW3T6IPIELXWSIHY6PLEPRTEKNGPX5HFWFQBRWN53WKHQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578034237 (142h32m0.009114368s) [noise=true , address=104.36.82.23:4469 , piece_id=36BCS3GUJDZHVRLZEQXNJUQ357QNSNFDPDCOFOA6GXOC6UFR7ZVQ, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578213589 (142h32m0.00929372s) [noise=true , address=77.90.31.18:4836 , piece_id=7TTFRT2ZLM3RAPVNLMSO5SGNFFJBZT5ABLAD4RP7RT4CVBG6R6DA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:05.578400677 (142h32m0.009480808s) [noise=true , address=77.90.31.21:4894 , piece_id=TXKMA72IVJ35RLNPDFGDGI7PZUKAONRYFGCFWRAKX3IV3LW6XKPA, seg_pos={0 0}, upload=148250]: Uploading piece...
Aug 14 15:58:06.700651660 (142h32m1.131731791s) [upload=148250]: Next returned nil segment
Aug 14 15:58:06.700667500 (142h32m1.131747631s) [upload=148250]: Waiting for error group managing segments...
Aug 14 15:58:06.983878641 (142h32m1.414958772s) [noise=true , address=66.23.193.175:4563 , piece_id=5DNK36NIVJGARKWXRSO6OLXEAO3QL4ZVVHK5Q7CG7O5GVX2ZXTTA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.509408950 (142h32m1.940489071s) [noise=true , address=79.127.201.215:4350 , piece_id=MN2LO6GJUAVZYBZ3A6HWIMJPWHH5XLR2FJ6ZQGYIMBKEJE4IXVWA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.584144688 (142h32m2.015224819s) [noise=true , address=104.36.82.36:4637 , piece_id=BIKBTGI3BAMHNWUC34LS64XN7OULI3D54BX6RGEYJUCCZZOTQYZQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.616107745 (142h32m2.047187876s) [noise=true , address=104.36.82.59:4312 , piece_id=4CAPF76G6TQKMDYPI3BLTW3UQH2OJ3DU7FE45YIGOVXHU4I54SMA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.678989211 (142h32m2.110069343s) [noise=true , address=104.36.82.8:4001 , piece_id=YYE63QJSZFB6O43EAOMJV3C3XBPJBNK77M6UKAVXDVCVPIZJ4IPQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.680052216 (142h32m2.111132347s) [noise=true , address=77.90.31.16:4741 , piece_id=XWKKYRNV5MIBFF5YNBK23QTPGWYM2DZQI4MCFD5RWK5LN3RY2W2A, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.681533168 (142h32m2.112613289s) [noise=true , address=77.90.31.11:4565 , piece_id=2NBQMKGMONVNCQMOTOB4KFX6Y4OYHQRBFKRY6EOLFDXRY5PP6IWQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.687149425 (142h32m2.118229556s) [noise=true , address=77.90.31.15:4724 , piece_id=PIZNAOUCMI2HCWGSLWS4JYDIDDSVZNHIVRQTZS2CR7WZ7BPYAOVA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.750021633 (142h32m2.181101765s) [noise=true , address=77.90.31.19:4849 , piece_id=FMOJA25VSHTHT7GZUXKNULKGYY3RHOD2AVMEQAD5K25VZC667OIA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.758053882 (142h32m2.189134013s) [noise=true , address=77.90.31.12:4607 , piece_id=K3YPCDXXW3T6IPIELXWSIHY6PLEPRTEKNGPX5HFWFQBRWN53WKHQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.767592053 (142h32m2.198672184s) [noise=true , address=77.90.31.21:4894 , piece_id=TXKMA72IVJ35RLNPDFGDGI7PZUKAONRYFGCFWRAKX3IV3LW6XKPA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.781512538 (142h32m2.212592669s) [noise=true , address=77.90.31.18:4836 , piece_id=7TTFRT2ZLM3RAPVNLMSO5SGNFFJBZT5ABLAD4RP7RT4CVBG6R6DA, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:07.866054669 (142h32m2.297134801s) [noise=true , address=104.36.82.4:4823 , piece_id=Q3AE5UGUAYYZ5XDGQMGDOS5GGHJSKWHPPR6YSRIZUPCY3FYX4K4A, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:09.058161132 (142h32m3.489241263s) [noise=true , address=104.36.82.34:4556 , piece_id=VTTA4SLPRXOUUBDJ4D72VKH4ND55N32S526SWVJD5GYQEZCZMKHQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: <nil>
Aug 14 15:58:09.058187202 (142h32m3.489267333s) [seg_pos={0 0}, upload=148250]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:58:09.058441549 (142h32m3.48952168s) [noise=true , address=104.36.82.35:4613 , piece_id=FQ46Z6MPBW2DKSXIHZCEJNJ62I3XDFX2ENLOSE2CHLYWCGNOUWCQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xjm7XPPwM9nXBP3SS36HeLNxBVJdEpcQyD9BAp79xbGCze4vL): protocol: expected piece hash; context canceled; EOF
Aug 14 15:58:09.058462429 (142h32m3.48954256s) [noise=true , address=104.36.82.5:4860 , piece_id=5PMETX2VB2HJECFLY6ROCHESTAUXVK6FDRCBGMLFZDIBBAXH242Q, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection; write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34206->104.36.82.5:4860: use of closed network connection
Aug 14 15:58:09.058512084 (142h32m3.489592215s) [noise=true , address=104.36.82.23:4469 , piece_id=36BCS3GUJDZHVRLZEQXNJUQ357QNSNFDPDCOFOA6GXOC6UFR7ZVQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: read tcp 188.166.225.170:38284->104.36.82.23:4469: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 15:58:09.058523706 (142h32m3.489603837s) [noise=true , address=104.36.82.60:4372 , piece_id=ZIPW5JETCNLLYHN4ETZKFUHHG65LGL6EN5GPKY74OHQTB6SXKTIQ, seg_pos={0 0}, upload=148250]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kJnsSPzFa7JwUMHuvosMmFrGvQ8tCsQbjwWdxbqjHNHgTfaL3): protocol: expected piece hash; context canceled; EOF
Aug 14 15:58:09.058538414 (142h32m3.489618545s) [seg_pos={0 0}, upload=148250]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:58:09.058617446 (142h32m3.489697577s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:58:09.058621624 (142h32m3.489701755s) [upload=148250]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:58:09.385842712 (142h32m3.816922843s) [upload=148250]: Done uploading segments...
Aug 14 15:58:09.385860636 (142h32m3.816940757s) [upload=148250]: Upload finished. err: <nil>
Duration: 5.584760922s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration:
6.259207956s
FAIL (2025-08-14 15:57:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after df9ee14796e27cf2f111f5b2265a22ebe96ffe64cb29d54eef3248bb1b09e5df != before a32a78049f79a7e54c13bb9307ce23d1920f7edeb06e53e14b4bc5b66af94cd5
======LOGS======
Aug 14 15:51:14.887087082 (142h25m9.318167213s) [upload=148137]: Starting upload
Aug 14 15:51:14.887135043 (142h25m9.318215174s) [upload=148137]: Done starting upload
Aug 14 15:51:14.887304569 (142h25m9.3183847s) [upload=148137]: Uploading segments...
Aug 14 15:51:14.887332742 (142h25m9.318412874s) [upload=148137]: Got next segment. Inline: false
Aug 14 15:51:14.887358662 (142h25m9.318438793s) [upload=148137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:51:14.887362620 (142h25m9.318442751s) [upload=148137]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:51:15.333886045 (142h25m9.764966176s) [seg_pos={0 0}, upload=148137]: Begin upload segment...
Aug 14 15:51:15.333929518 (142h25m9.765009649s) [seg_pos={0 0}, upload=148137]: Done begin upload segment.
Aug 14 15:51:15.333954826 (142h25m9.765034947s) [noise=true , address=77.90.31.11:4582 , piece_id=WEPTKEK2K2TUL7IOL64WCPTWCFBXFROPMJA6FTPYQKL7WKDFYO5A, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.334007878 (142h25m9.765087999s) [noise=true , address=104.36.82.59:4306 , piece_id=RNO244GPNCAOEAKRUMXILEQKIAEKCPCYLBOJOESCSUUHCKJ4T7IQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.334331057 (142h25m9.765411188s) [noise=true , address=104.36.82.39:4754 , piece_id=Y6JTKWMXUKNRFT3RR6U5RTPKVIC3KMBYOKVLVQBMSMIVHYJQNCYA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.334516602 (142h25m9.765596733s) [noise=true , address=104.36.82.60:4365 , piece_id=IPII2XC37BMV3H2PEOSRWHIIU2JP3W6A4W6LN4IZ26UDFCQR7V5A, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.334857263 (142h25m9.765937394s) [noise=true , address=104.36.82.19:4411 , piece_id=GFQEY6A6NF5YB5FH5H5L7ETPXCHDM33D7PMEIELQ4OIDGOTNXSJQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335047567 (142h25m9.766127698s) [noise=true , address=104.36.82.8:4987 , piece_id=Y57TQLSPLTMLFFM73OR3Y4OZSW64WOZHUBUQAXEPZFHQQINWAYXQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335215208 (142h25m9.766295369s) [noise=true , address=104.36.82.37:4666 , piece_id=IA4RTTK3H632M6NFXEXMPY3NUVN5MLTKUVLOHUM3K6R3ROL4JEVA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335319197 (142h25m9.766399318s) [noise=true , address=66.23.193.175:4564 , piece_id=C6R4RL6U3DPDIIJU6EBEZWG5726OMYEGFE3673UPTML4HGQ4HAWQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335569807 (142h25m9.766649938s) [noise=true , address=104.36.82.38:4710 , piece_id=7DJPKFCMHUQPTSI6NJRO2SBRSCLKF7TY5FWPRZ4DFRUTSK5XNEUA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335646604 (142h25m9.766726735s) [noise=true , address=79.127.205.235:4667 , piece_id=FEB5773TPSJJNC6F55U7SL2DGQOXX7QCLMHE7BJVBPDKRGLUXWHA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335835876 (142h25m9.766915997s) [noise=true , address=104.36.82.5:4850 , piece_id=RGWQEXNAXGJLQSRCG4MPZFXICORCC6OSHLIJ6TOJ7PRPVSLOO7KQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.335977767 (142h25m9.767057898s) [noise=true , address=104.36.82.58:4274 , piece_id=I7P6CHRD2YL3USCQ7DP65N4Y7XBBHMYC5QDZ4KSX6UAYSSBZMXTA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336085393 (142h25m9.767165524s) [noise=true , address=77.90.31.12:4610 , piece_id=VU4HKWR7JIRRU4D7ZBPCLB5SIFCQIJKDR3XZIOB4CAMYCXJTMM6Q, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336245019 (142h25m9.76732515s) [noise=true , address=104.36.82.23:4478 , piece_id=XBVLUJ5FK573ZYDXGQBKGSYFC6LSDOZKIGMKBKFTBT7HNEMT3FIQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336340551 (142h25m9.767420672s) [noise=true , address=77.90.31.19:4846 , piece_id=QLNWRZWCRMUX4HYJUFI2GZV2XDU6N4OKWKSPLPTISP5KXHJMLCOA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336573027 (142h25m9.767653158s) [noise=true , address=104.36.82.44:4895 , piece_id=2ZWK2ALO3W27RIZAD5BQ6X23XWCVO2U244SDQRCQUGNU2BZMEEGQ, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336672366 (142h25m9.767752487s) [noise=true , address=104.36.82.36:4628 , piece_id=BD2CLUGE4KTQQ4HCCX6UH5YIE5OBIJZ32JXK3LVWCVS4YH6EEKNA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:15.336924519 (142h25m9.76800465s) [noise=true , address=104.36.82.35:4597 , piece_id=KJHUR5YZHGQAGX6ARHIHGZNXNPTJGJVUKVVQOPMNTKOQE2CK2RKA, seg_pos={0 0}, upload=148137]: Uploading piece...
Aug 14 15:51:16.468585862 (142h25m10.899665993s) [upload=148137]: Next returned nil segment
Aug 14 15:51:16.468607153 (142h25m10.899687284s) [upload=148137]: Waiting for error group managing segments...
Aug 14 15:51:16.794433516 (142h25m11.225513647s) [noise=true , address=66.23.193.175:4564 , piece_id=C6R4RL6U3DPDIIJU6EBEZWG5726OMYEGFE3673UPTML4HGQ4HAWQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:16.805832547 (142h25m11.236912679s) [noise=true , address=79.127.205.235:4667 , piece_id=FEB5773TPSJJNC6F55U7SL2DGQOXX7QCLMHE7BJVBPDKRGLUXWHA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.292284530 (142h25m11.723364671s) [noise=true , address=104.36.82.38:4710 , piece_id=7DJPKFCMHUQPTSI6NJRO2SBRSCLKF7TY5FWPRZ4DFRUTSK5XNEUA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.312085888 (142h25m11.743166019s) [noise=true , address=104.36.82.37:4666 , piece_id=IA4RTTK3H632M6NFXEXMPY3NUVN5MLTKUVLOHUM3K6R3ROL4JEVA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.389758957 (142h25m11.820839088s) [noise=true , address=77.90.31.11:4582 , piece_id=WEPTKEK2K2TUL7IOL64WCPTWCFBXFROPMJA6FTPYQKL7WKDFYO5A, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.401873467 (142h25m11.832953598s) [noise=true , address=77.90.31.12:4610 , piece_id=VU4HKWR7JIRRU4D7ZBPCLB5SIFCQIJKDR3XZIOB4CAMYCXJTMM6Q, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.425938032 (142h25m11.857018163s) [noise=true , address=77.90.31.19:4846 , piece_id=QLNWRZWCRMUX4HYJUFI2GZV2XDU6N4OKWKSPLPTISP5KXHJMLCOA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.505592492 (142h25m11.936672623s) [noise=true , address=104.36.82.59:4306 , piece_id=RNO244GPNCAOEAKRUMXILEQKIAEKCPCYLBOJOESCSUUHCKJ4T7IQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.517140918 (142h25m11.948221049s) [noise=true , address=104.36.82.19:4411 , piece_id=GFQEY6A6NF5YB5FH5H5L7ETPXCHDM33D7PMEIELQ4OIDGOTNXSJQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.786784853 (142h25m12.217864984s) [noise=true , address=104.36.82.39:4754 , piece_id=Y6JTKWMXUKNRFT3RR6U5RTPKVIC3KMBYOKVLVQBMSMIVHYJQNCYA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:17.821939467 (142h25m12.253019598s) [noise=true , address=104.36.82.23:4478 , piece_id=XBVLUJ5FK573ZYDXGQBKGSYFC6LSDOZKIGMKBKFTBT7HNEMT3FIQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:18.570427829 (142h25m13.00150795s) [noise=true , address=104.36.82.8:4987 , piece_id=Y57TQLSPLTMLFFM73OR3Y4OZSW64WOZHUBUQAXEPZFHQQINWAYXQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:18.868624998 (142h25m13.299705129s) [noise=true , address=104.36.82.60:4365 , piece_id=IPII2XC37BMV3H2PEOSRWHIIU2JP3W6A4W6LN4IZ26UDFCQR7V5A, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:19.042614759 (142h25m13.47369489s) [noise=true , address=104.36.82.36:4628 , piece_id=BD2CLUGE4KTQQ4HCCX6UH5YIE5OBIJZ32JXK3LVWCVS4YH6EEKNA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: <nil>
Aug 14 15:51:19.042645778 (142h25m13.473725909s) [seg_pos={0 0}, upload=148137]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:51:19.042887801 (142h25m13.473967932s) [noise=true , address=104.36.82.5:4850 , piece_id=RGWQEXNAXGJLQSRCG4MPZFXICORCC6OSHLIJ6TOJ7PRPVSLOO7KQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; context canceled; EOF
Aug 14 15:51:19.042956793 (142h25m13.474036924s) [noise=true , address=104.36.82.35:4597 , piece_id=KJHUR5YZHGQAGX6ARHIHGZNXNPTJGJVUKVVQOPMNTKOQE2CK2RKA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GsSshFB2sM59Asac3cP8EbaTXGZLUUQYTBDxWzPpfiRipQfsf): protocol: write tcp 188.166.225.170:56468->104.36.82.35:4597: use of closed network connection; write tcp 188.166.225.170:56468->104.36.82.35:4597: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56468->104.36.82.35:4597: use of closed network connection
Aug 14 15:51:19.043049721 (142h25m13.474129872s) [noise=true , address=104.36.82.58:4274 , piece_id=I7P6CHRD2YL3USCQ7DP65N4Y7XBBHMYC5QDZ4KSX6UAYSSBZMXTA, seg_pos={0 0}, upload=148137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129cCwcw9NVVWnGekaWEGhSam1K3TZDcFVPdzZ32aQvP8kYVtZi): protocol: expected piece hash; context canceled; EOF
Aug 14 15:51:19.043093464 (142h25m13.474173675s) [noise=true , address=104.36.82.44:4895 , piece_id=2ZWK2ALO3W27RIZAD5BQ6X23XWCVO2U244SDQRCQUGNU2BZMEEGQ, seg_pos={0 0}, upload=148137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p99EPp3sCPSTEivuuBYRv791ysLFqRBwBp1LCpuAmtpasydTu): protocol: read tcp 188.166.225.170:48472->104.36.82.44:4895: use of closed network connection; conn closed: op
Aug 14 15:51:19.043122931 (142h25m13.474203063s) [seg_pos={0 0}, upload=148137]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:51:19.043205790 (142h25m13.474285921s) [upload=148137]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:51:19.043210248 (142h25m13.474290379s) [upload=148137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:51:19.361243871 (142h25m13.792324002s) [upload=148137]: Done uploading segments...
Aug 14 15:51:19.361261956 (142h25m13.792342077s) [upload=148137]: Upload finished. err: <nil>
Duration: 6.259235039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..XX.....X.......X.......X..................................] duration:
1.87718529s
FAIL (2025-08-14 15:57:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 15:31:50.473046898 (142h5m44.904127029s) [upload=147807]: Starting upload Aug 14 15:31:50.473091744 (142h5m44.904171865s) [upload=147807]: Done starting upload Aug 14 15:31:50.473145377 (142h5m44.904225498s) [upload=147807]: Uploading segments... Aug 14 15:31:50.473193288 (142h5m44.90427341s) [upload=147807]: Got next segment. Inline: true Aug 14 15:31:50.473197256 (142h5m44.904277387s) [upload=147807]: Waiting for error group managing segments... Aug 14 15:31:50.473228095 (142h5m44.904308226s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:31:50.473232022 (142h5m44.904312153s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:31:50.473234577 (142h5m44.904314698s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:31:55.112783721 (142h5m49.543863852s) [upload=147807]: Done uploading segments... Aug 14 15:31:55.112802908 (142h5m49.543883039s) [upload=147807]: Upload finished. err: <nil>
Duration: 1.877218312s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..XX.....X.......X.......X.................................] duration:
1.882537841s
FAIL (2025-08-14 15:56:51 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 15:31:50.473046898 (142h5m44.904127029s) [upload=147807]: Starting upload Aug 14 15:31:50.473091744 (142h5m44.904171865s) [upload=147807]: Done starting upload Aug 14 15:31:50.473145377 (142h5m44.904225498s) [upload=147807]: Uploading segments... Aug 14 15:31:50.473193288 (142h5m44.90427341s) [upload=147807]: Got next segment. Inline: true Aug 14 15:31:50.473197256 (142h5m44.904277387s) [upload=147807]: Waiting for error group managing segments... Aug 14 15:31:50.473228095 (142h5m44.904308226s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:31:50.473232022 (142h5m44.904312153s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:31:50.473234577 (142h5m44.904314698s) [upload=147807]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:31:55.112783721 (142h5m49.543863852s) [upload=147807]: Done uploading segments... Aug 14 15:31:55.112802908 (142h5m49.543883039s) [upload=147807]: Upload finished. err: <nil>
Duration: 1.882578158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|