Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..............................................X] duration:
4.178107199s
FAIL (2025-08-13 05:13:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 05:13:25.820803046 (107h47m20.251883177s) [upload=112187]: Starting upload
Aug 13 05:13:25.820905762 (107h47m20.251985924s) [upload=112187]: Done starting upload
Aug 13 05:13:25.820999261 (107h47m20.252079392s) [upload=112187]: Uploading segments...
Aug 13 05:13:25.821383636 (107h47m20.252463788s) [upload=112187]: Got next segment. Inline: false
Aug 13 05:13:25.821423854 (107h47m20.252503985s) [upload=112187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:13:25.821431027 (107h47m20.252511158s) [upload=112187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 05:13:26.300129199 (107h47m20.73120933s) [seg_pos={0 0}, upload=112187]: Begin upload segment...
Aug 13 05:13:26.300175889 (107h47m20.73125602s) [seg_pos={0 0}, upload=112187]: Done begin upload segment.
Aug 13 05:13:26.300198522 (107h47m20.731278643s) [noise=true , address=104.36.82.59:4301 , piece_id=V4D5TXEKONCBWNIHOCOUGSM5EKMKDN2VO34P5VMIQWLADTF6QDTA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.300281841 (107h47m20.731361962s) [noise=true , address=104.36.82.23:4477 , piece_id=JK5LJXDE2XUQXT7PMX5SJJ3WRHFB7UC2E65IBA76SPTQEWRAYQQQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.300614378 (107h47m20.731694509s) [noise=true , address=77.90.31.11:4579 , piece_id=C3RORS2XNQYMCIG2L3MEUGZ4PT2NXRQKSWCPON4IBL3NPB5MTJXA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.300834509 (107h47m20.73191464s) [noise=true , address=104.36.82.9:4025 , piece_id=D4UTXCBCLNKNFUPZCOCG2DSTNUBT5GVOL24X75RZY7ZAK4W3BZ7A, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.300898000 (107h47m20.731978131s) [noise=true , address=64.49.13.140:4511 , piece_id=37RBGBEYJYDZZWXYTQ5EV4I6TRWNBHHSEVTL7ZKX7NXOEFBJYY4Q, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301170071 (107h47m20.732250202s) [noise=true , address=79.127.201.215:4348 , piece_id=DMQXMKIKAIPA5RI4SQFWXOPCDVSDI2D3JNEFAUSYXCYBNC6KO5WA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301180019 (107h47m20.73226015s) [noise=true , address=77.90.31.19:4850 , piece_id=OJAJZIDEUTSCQUZFEWI6E66GWQRT54PH2IBTRMCP6W5VS4XHRGAA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301461519 (107h47m20.73254165s) [noise=true , address=79.127.219.38:4016 , piece_id=I262UEIE7KIBZCFXSXZAKBUHRKRWR23G4CIPGQ2A3CNGFHVSSVPA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301498739 (107h47m20.73257886s) [noise=true , address=77.90.31.10:4525 , piece_id=QJZTYAM62CKE7NQLMLQRVRMIHPBPKVBSWWLLLSVEEDY67LL4POYQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301746994 (107h47m20.732827115s) [noise=true , address=104.36.82.38:4706 , piece_id=P7NVETPRNNCJRFJK2BHGJBK6LDPBBW23I6HUHS7AKCUTVG5RDZWA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.301852456 (107h47m20.732932587s) [noise=true , address=104.36.82.34:4577 , piece_id=2CZVY3XAYGEQACWWYDYUYVR7KF34CICGLPNYNYAV5VDPQM6CUP3Q, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302083358 (107h47m20.733163489s) [noise=true , address=77.90.31.12:4612 , piece_id=ZA4TNC7I4AMM5P26CCR3NNO2GJUHYS5YNQGIX2JHEQFJEXYDOPHA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302134105 (107h47m20.733214226s) [noise=true , address=64.49.13.26:4946 , piece_id=KZWJVKI2GGHDBRBWYHEPQ73OFKAYZOLFV54DIF4GKKETS4BGHECQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302327405 (107h47m20.733407526s) [noise=true , address=193.149.164.143:4693 , piece_id=6ZCBMKW344K6OVCV5B4T46MBI247CCZP2VVQAVIMZURENQVAIJZQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302417989 (107h47m20.73349812s) [noise=true , address=104.36.82.60:4361 , piece_id=CNZLLPMWUVYNTM6CFA2JLVWSID75FRYPB6MAQVADY6FD24IPKUTQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302561193 (107h47m20.733641314s) [noise=true , address=104.36.82.16:4308 , piece_id=Z3E5WBSKGJSQR2VBROYXSL2D4PKL35BKUJ4ZRVSFZFEQTVBQCSBQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.302679078 (107h47m20.733759209s) [noise=true , address=104.36.82.62:4427 , piece_id=UV2ZYX7YIC5WT7HYOKNJL4EG4QBMOXPF4WMOQ2MCDX5NIV7IX5WA, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:26.303372444 (107h47m20.734452575s) [noise=true , address=104.36.82.8:4001 , piece_id=7MNPOYMFFI6RAYS4L3NSKC63RXTDA6BLZBP5VSNGRNBSEHS42NXQ, seg_pos={0 0}, upload=112187]: Uploading piece...
Aug 13 05:13:27.443804199 (107h47m21.87488433s) [upload=112187]: Next returned nil segment
Aug 13 05:13:27.443824338 (107h47m21.874904469s) [upload=112187]: Waiting for error group managing segments...
Aug 13 05:13:27.733331002 (107h47m22.164411123s) [noise=true , address=64.49.13.140:4511 , piece_id=37RBGBEYJYDZZWXYTQ5EV4I6TRWNBHHSEVTL7ZKX7NXOEFBJYY4Q, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:27.739051538 (107h47m22.170131669s) [noise=true , address=193.149.164.143:4693 , piece_id=6ZCBMKW344K6OVCV5B4T46MBI247CCZP2VVQAVIMZURENQVAIJZQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:27.925942023 (107h47m22.357022154s) [noise=true , address=64.49.13.26:4946 , piece_id=KZWJVKI2GGHDBRBWYHEPQ73OFKAYZOLFV54DIF4GKKETS4BGHECQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.232028079 (107h47m22.66310821s) [noise=true , address=77.90.31.19:4850 , piece_id=OJAJZIDEUTSCQUZFEWI6E66GWQRT54PH2IBTRMCP6W5VS4XHRGAA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.232398529 (107h47m22.66347866s) [noise=true , address=77.90.31.12:4612 , piece_id=ZA4TNC7I4AMM5P26CCR3NNO2GJUHYS5YNQGIX2JHEQFJEXYDOPHA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.238326390 (107h47m22.669406521s) [noise=true , address=77.90.31.11:4579 , piece_id=C3RORS2XNQYMCIG2L3MEUGZ4PT2NXRQKSWCPON4IBL3NPB5MTJXA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.292034622 (107h47m22.723114764s) [noise=true , address=104.36.82.62:4427 , piece_id=UV2ZYX7YIC5WT7HYOKNJL4EG4QBMOXPF4WMOQ2MCDX5NIV7IX5WA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.303328281 (107h47m22.734408412s) [noise=true , address=104.36.82.9:4025 , piece_id=D4UTXCBCLNKNFUPZCOCG2DSTNUBT5GVOL24X75RZY7ZAK4W3BZ7A, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.337624201 (107h47m22.768704332s) [noise=true , address=77.90.31.10:4525 , piece_id=QJZTYAM62CKE7NQLMLQRVRMIHPBPKVBSWWLLLSVEEDY67LL4POYQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.366365873 (107h47m22.797446004s) [noise=true , address=104.36.82.59:4301 , piece_id=V4D5TXEKONCBWNIHOCOUGSM5EKMKDN2VO34P5VMIQWLADTF6QDTA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.368549472 (107h47m22.799629603s) [noise=true , address=104.36.82.8:4001 , piece_id=7MNPOYMFFI6RAYS4L3NSKC63RXTDA6BLZBP5VSNGRNBSEHS42NXQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.372064677 (107h47m22.803144798s) [noise=true , address=104.36.82.60:4361 , piece_id=CNZLLPMWUVYNTM6CFA2JLVWSID75FRYPB6MAQVADY6FD24IPKUTQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.392627772 (107h47m22.823707893s) [noise=true , address=104.36.82.38:4706 , piece_id=P7NVETPRNNCJRFJK2BHGJBK6LDPBBW23I6HUHS7AKCUTVG5RDZWA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.404997599 (107h47m22.83607772s) [noise=true , address=104.36.82.16:4308 , piece_id=Z3E5WBSKGJSQR2VBROYXSL2D4PKL35BKUJ4ZRVSFZFEQTVBQCSBQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: <nil>
Aug 13 05:13:28.405026134 (107h47m22.836106335s) [seg_pos={0 0}, upload=112187]: Segment reached optimal threshold of 14 pieces.
Aug 13 05:13:28.405128330 (107h47m22.836208461s) [noise=true , address=79.127.219.38:4016 , piece_id=I262UEIE7KIBZCFXSXZAKBUHRKRWR23G4CIPGQ2A3CNGFHVSSVPA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HBQf6xPSEdSo991JQZiiJXAk1xT8Jy4GG4r8khUqWjYB1pJDv): protocol: expected piece hash; context canceled; EOF
Aug 13 05:13:28.405214805 (107h47m22.836294936s) [noise=true , address=104.36.82.34:4577 , piece_id=2CZVY3XAYGEQACWWYDYUYVR7KF34CICGLPNYNYAV5VDPQM6CUP3Q, seg_pos={0 0}, upload=112187]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129EkvQCWxahFtpWNwEviNgeT9HutToW6yt2T9wEkRi29gcFaUP): protocol: expected piece hash; context canceled; EOF
Aug 13 05:13:28.405258187 (107h47m22.836338318s) [noise=true , address=79.127.201.215:4348 , piece_id=DMQXMKIKAIPA5RI4SQFWXOPCDVSDI2D3JNEFAUSYXCYBNC6KO5WA, seg_pos={0 0}, upload=112187]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: expected piece hash; context canceled; EOF
Aug 13 05:13:28.405285079 (107h47m22.8363652s) [noise=true , address=104.36.82.23:4477 , piece_id=JK5LJXDE2XUQXT7PMX5SJJ3WRHFB7UC2E65IBA76SPTQEWRAYQQQ, seg_pos={0 0}, upload=112187]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RP2Zq643WWNtKEr34Tq1iZS29NYA2okr9Fg1jiCpaFTqfLauf): protocol: expected piece hash; context canceled; EOF
Aug 13 05:13:28.405307141 (107h47m22.836387262s) [seg_pos={0 0}, upload=112187]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 05:13:28.405398536 (107h47m22.836478667s) [upload=112187]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 05:13:28.405403055 (107h47m22.836483186s) [upload=112187]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:13:28.687345667 (107h47m23.118425798s) [upload=112187]: Done uploading segments...
Aug 13 05:13:28.687367339 (107h47m23.11844747s) [upload=112187]: Upload finished. err: <nil>
Duration: 4.178133659s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.........................X.............................X] duration:
1.642553466s
FAIL (2025-08-13 05:13:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 13 05:13:08.998430489 (107h47m3.42951062s) [upload=112183]: Starting upload
Aug 13 05:13:08.998492357 (107h47m3.429572488s) [upload=112183]: Done starting upload
Aug 13 05:13:08.998564806 (107h47m3.429644937s) [upload=112183]: Uploading segments...
Aug 13 05:13:08.998604442 (107h47m3.429684573s) [upload=112183]: Got next segment. Inline: true
Aug 13 05:13:08.998610784 (107h47m3.429690915s) [upload=112183]: Waiting for error group managing segments...
Aug 13 05:13:08.998652003 (107h47m3.429732134s) [upload=112183]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 05:13:08.998656010 (107h47m3.429736141s) [upload=112183]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 13 05:13:08.998658595 (107h47m3.429738726s) [upload=112183]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 05:13:09.300958699 (107h47m3.73203883s) [upload=112183]: Done uploading segments...
Aug 13 05:13:09.300976702 (107h47m3.732056824s) [upload=112183]: Upload finished. err: <nil>
Duration: 1.642579044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.........................X.............................] duration:
1.851916055s
FAIL (2025-08-13 05:12:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.851940362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.738591773s
FAIL (2025-08-13 05:12:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.738636338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.774526282s
FAIL (2025-08-13 05:12:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.774553604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........................X............................] duration:
1.875781798s
FAIL (2025-08-13 05:12:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875807598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.........................X...........................] duration:
2.081299376s
FAIL (2025-08-13 05:11:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.081337579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.592682294s
FAIL (2025-08-13 05:11:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.592710768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........................X..........................] duration:
1.891169809s
FAIL (2025-08-13 05:11:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.891197413s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.032338033s
FAIL (2025-08-13 05:10:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.032374793s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.784016018s
FAIL (2025-08-13 05:10:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.784044894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.........................X.........................] duration:
2.020558905s
FAIL (2025-08-13 05:09:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.020595376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.000562714s
FAIL (2025-08-13 05:09:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.00059734s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.........................X........................] duration:
1.835892487s
FAIL (2025-08-13 05:09:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.835923557s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.569104028s
FAIL (2025-08-13 05:08:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.569131211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.........................X.......................] duration:
1.821853845s
FAIL (2025-08-13 05:07:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.821904582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.858027571s
FAIL (2025-08-13 05:07:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.858052678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.797433672s
FAIL (2025-08-13 05:06:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.797454914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.........................X......................] duration:
1.85439036s
FAIL (2025-08-13 05:06:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854408535s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.060500721s
FAIL (2025-08-13 05:06:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.060633945s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.........................X.....................] duration:
2.062796681s
FAIL (2025-08-13 05:06:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.062827311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.........................X....................] duration:
1.827058864s
FAIL (2025-08-13 05:06:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.827085034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.........................X...................] duration:
1.898033284s
FAIL (2025-08-13 05:05:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.898060927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.........................X..................] duration:
1.825092873s
FAIL (2025-08-13 05:05:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.825125576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
6.459462008s
FAIL (2025-08-13 05:05:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.459485724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.........................X.................] duration:
1.901493103s
FAIL (2025-08-13 05:05:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.901526237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.........................X................] duration:
1.840757645s
FAIL (2025-08-13 05:04:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840782321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.932131225s
FAIL (2025-08-13 05:04:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.932170822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.927729236s
FAIL (2025-08-13 05:03:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.927751848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.........................X...............] duration:
1.994399015s
FAIL (2025-08-13 05:03:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.994441746s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.606135652s
FAIL (2025-08-13 05:03:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.606163795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.........................X..............] duration:
2.052981171s
FAIL (2025-08-13 05:02:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.053025236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.814669802s
FAIL (2025-08-13 05:02:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.814701272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.........................X.............] duration:
2.023131477s
FAIL (2025-08-13 05:01:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.02317498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.099450426s
FAIL (2025-08-13 05:01:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.099480724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.189157838s
FAIL (2025-08-13 05:00:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 6.189185099s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.........................X............] duration:
1.866170619s
FAIL (2025-08-13 05:00:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.86619191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.983625465s
FAIL (2025-08-13 05:00:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.983652637s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.........................X...........] duration:
1.961327558s
FAIL (2025-08-13 05:00:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.961354589s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
8.541939997s
FAIL (2025-08-13 05:00:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.541971528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
7.663962282s
FAIL (2025-08-13 04:59:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.663979293s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.763244257s
FAIL (2025-08-13 04:59:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.763262653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.........................X..........] duration:
1.896699813s
FAIL (2025-08-13 04:59:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896721245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
8.517288161s
FAIL (2025-08-13 04:58:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.51730864s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.........................X.........] duration:
1.96590234s
FAIL (2025-08-13 04:58:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.965926436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.849508654s
FAIL (2025-08-13 04:57:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.849534262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
8.796586561s
FAIL (2025-08-13 04:57:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.796611339s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.........................X........] duration:
2.181450018s
FAIL (2025-08-13 04:57:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.181484051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.546343685s
FAIL (2025-08-13 04:56:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 04:35:54.793148420 (107h9m49.224228561s) [upload=111532]: Starting upload
Aug 13 04:35:54.793209617 (107h9m49.224289748s) [upload=111532]: Done starting upload
Aug 13 04:35:54.793316461 (107h9m49.224396593s) [upload=111532]: Uploading segments...
Aug 13 04:35:54.793430610 (107h9m49.224510731s) [upload=111532]: Got next segment. Inline: false
Aug 13 04:35:54.793554506 (107h9m49.224634637s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 04:35:54.793560358 (107h9m49.224640489s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 04:35:55.251500973 (107h9m49.682581114s) [seg_pos={0 0}, upload=111532]: Begin upload segment...
Aug 13 04:35:55.251562933 (107h9m49.682643064s) [seg_pos={0 0}, upload=111532]: Done begin upload segment.
Aug 13 04:35:55.251592850 (107h9m49.682672981s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.251640200 (107h9m49.682720331s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252129516 (107h9m49.683209657s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252263212 (107h9m49.683343343s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252446683 (107h9m49.683526814s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252674649 (107h9m49.68375478s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252723483 (107h9m49.683803614s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.252973952 (107h9m49.684054083s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253217899 (107h9m49.68429803s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253493757 (107h9m49.684573888s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253729076 (107h9m49.684809207s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.253951341 (107h9m49.685031473s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254152948 (107h9m49.685233079s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254353331 (107h9m49.685433462s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254560177 (107h9m49.685640308s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254753066 (107h9m49.685833197s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.254998255 (107h9m49.686078387s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:55.255202205 (107h9m49.686282336s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Uploading piece...
Aug 13 04:35:56.355719157 (107h9m50.786799288s) [upload=111532]: Next returned nil segment
Aug 13 04:35:56.355734617 (107h9m50.786814748s) [upload=111532]: Waiting for error group managing segments...
Aug 13 04:35:56.681540013 (107h9m51.112620144s) [noise=true , address=64.49.13.140:4506 , piece_id=Z4QORZQ7AFIAWTKYLX4FMT7627WJA4IEDGCKLSKQHA553E2XISUA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:56.771566774 (107h9m51.202646895s) [noise=true , address=66.23.193.175:4554 , piece_id=EM7YN7DO7KLDVG5KOT3IJN3LEVWPNJOPBNGRBM6GKSPHIS2VEHBA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.205665703 (107h9m51.636745834s) [noise=true , address=104.36.82.9:4025 , piece_id=WPYLP2ZJS6FIWHNNORZJUPIOIQTHIYM6JLLB5LB73Q5SL6IUA55A, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.212355693 (107h9m51.643435824s) [noise=true , address=45.91.116.9:4266 , piece_id=MMFUYW7BHO7D4CPEE2HXIZI2HX6QZX5TIJAFTCU6FOBOCTTWOHUQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.234601727 (107h9m51.665681858s) [noise=true , address=104.36.82.38:4716 , piece_id=5A57PNRXQXOJJEOXWME6GUHK4FMS44LU6VLGJ3ODSQCIXRGWNHYQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.235604687 (107h9m51.666684818s) [noise=true , address=104.36.82.22:4544 , piece_id=3FW6Y7TR2LR2NRTBJIX3KNQAD5KS5ZNQ5IUZLT4GHPOJXY77NZJQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.243559847 (107h9m51.674639998s) [noise=true , address=77.90.31.16:4756 , piece_id=IME22EXQVVOZMGJBVG4C3YKDEKOFQO2MYWXXN7ZWA3IBKWGYM7UQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.245581856 (107h9m51.676661987s) [noise=true , address=104.36.82.23:4458 , piece_id=ML2BS4JJPCWIGWCSMT26VEVHCUTUFEK2WQXLFQLMCYM3JTMVNXEA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.250633902 (107h9m51.681714033s) [noise=true , address=104.36.82.5:4872 , piece_id=BPE5XNM666GKMJFORYPRGAKBK6PQCHCJ6WMEGROMIVOGWDC6KCBQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.312164180 (107h9m51.743244362s) [noise=true , address=104.36.82.61:4394 , piece_id=TCXAXBX3VM4MHJAFMAFMJ6464KAZWZGMRUNOVWOQALJ6J65JTMRA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.325353556 (107h9m51.756433687s) [noise=true , address=104.36.82.35:4594 , piece_id=5XOZS63O2REYEX7O7NNJXN7YHRR72KWMM33AY77BZIGCGH6GZUSQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.345025115 (107h9m51.776105246s) [noise=true , address=77.90.31.19:4850 , piece_id=56VJ72F4HZSPXP2ERIWLI56UGIBFJHTN3TY44ZHMYQ7LU5FKZTSA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.349504736 (107h9m51.780584877s) [noise=true , address=104.36.82.34:4577 , piece_id=MAEYRTTLG4P76ZAOPV6LU63ZWWJMEQDLUZMZ3LYSO5LRPX575QKA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.371997913 (107h9m51.803078064s) [noise=true , address=104.36.82.37:4685 , piece_id=7S2RG7ANIAOTVYUTYMQSJARVIPPOF3EZHJWUOB5XGTEGFVW23YFQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: <nil>
Aug 13 04:35:57.372029183 (107h9m51.803109324s) [seg_pos={0 0}, upload=111532]: Segment reached optimal threshold of 14 pieces.
Aug 13 04:35:57.372262870 (107h9m51.803343001s) [noise=true , address=104.36.82.44:4884 , piece_id=6ATGNVR6D53RLPJRQZXMAQIUGIGWLCY6SMQYUCQSM7SCVZPCQHEQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372357411 (107h9m51.803437542s) [noise=true , address=79.127.201.215:4360 , piece_id=DLD6VILCBNME5SDDAODLFD34LAIQK3P2JWKNSAU54MAAF62NRYAQ, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y7dgLXYLTGGFXzHQ5ZYJ4f4kWYCoyiBhGesd1xqbTbnYjxNzG): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372371227 (107h9m51.803451358s) [noise=true , address=104.36.82.59:4336 , piece_id=GTURWRE3L24VECF3IHR5JPJJJHJIXJOCQY6VMRP6EX5OS7I7A3IA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF
Aug 13 04:35:57.372379634 (107h9m51.803459765s) [noise=true , address=104.36.82.60:4354 , piece_id=LV4AO6MUGIWB23DUIRMCPBKDDDAEJQEOGJTWCPXNQPYM6JD5PBGA, seg_pos={0 0}, upload=111532]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54736->104.36.82.60:4354: use of closed network connection
Aug 13 04:35:57.372397417 (107h9m51.803477548s) [seg_pos={0 0}, upload=111532]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 04:35:57.372479404 (107h9m51.803559535s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 04:35:57.372509822 (107h9m51.803589963s) [upload=111532]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 04:35:57.681213717 (107h9m52.112293848s) [upload=111532]: Done uploading segments...
Aug 13 04:35:57.681234457 (107h9m52.112314588s) [upload=111532]: Upload finished. err: <nil>
Duration: 5.546367169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.........................X.......] duration:
1.832069956s
FAIL (2025-08-13 04:56:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 04:52:01.081032033 (107h25m55.512112174s) [upload=111815]: Starting upload Aug 13 04:52:01.081121424 (107h25m55.512201555s) [upload=111815]: Done starting upload Aug 13 04:52:01.081223579 (107h25m55.51230371s) [upload=111815]: Uploading segments... Aug 13 04:52:01.081273565 (107h25m55.512353706s) [upload=111815]: Got next segment. Inline: true Aug 13 04:52:01.081293123 (107h25m55.512373254s) [upload=111815]: Waiting for error group managing segments... Aug 13 04:52:01.081339100 (107h25m55.512419231s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 04:52:01.081344872 (107h25m55.512425003s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 04:52:01.081348118 (107h25m55.512428259s) [upload=111815]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 04:52:01.293748522 (107h25m55.724828673s) [upload=111815]: Done uploading segments... Aug 13 04:52:01.293766095 (107h25m55.724846226s) [upload=111815]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832094994s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|