Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X...................X.X.X....] duration:
5.953809936s
FAIL (2025-08-18 01:00:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:57:57.297605729 (223h31m51.72868586s) [upload=232481]: Starting upload
Aug 18 00:57:57.297657728 (223h31m51.72873787s) [upload=232481]: Done starting upload
Aug 18 00:57:57.297727142 (223h31m51.728807273s) [upload=232481]: Uploading segments...
Aug 18 00:57:57.297968242 (223h31m51.729048373s) [upload=232481]: Got next segment. Inline: false
Aug 18 00:57:57.298014832 (223h31m51.729094963s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:57:57.298018959 (223h31m51.729099091s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:57:57.764766019 (223h31m52.19584614s) [seg_pos={0 0}, upload=232481]: Begin upload segment...
Aug 18 00:57:57.764807268 (223h31m52.195887399s) [seg_pos={0 0}, upload=232481]: Done begin upload segment.
Aug 18 00:57:57.764823368 (223h31m52.195903489s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.764833818 (223h31m52.195913959s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765173128 (223h31m52.196253259s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765466238 (223h31m52.196546369s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765741164 (223h31m52.196821295s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765998948 (223h31m52.197079079s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766242484 (223h31m52.197322615s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766481040 (223h31m52.197561161s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766791594 (223h31m52.197871725s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767033237 (223h31m52.198113368s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767229092 (223h31m52.198309223s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767563822 (223h31m52.198643963s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767766319 (223h31m52.19884644s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767953597 (223h31m52.199033728s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768174490 (223h31m52.199254621s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768413147 (223h31m52.199493278s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768666101 (223h31m52.199746232s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768850354 (223h31m52.199930485s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:59.270337793 (223h31m53.701417914s) [upload=232481]: Next returned nil segment
Aug 18 00:57:59.270354414 (223h31m53.701434545s) [upload=232481]: Waiting for error group managing segments...
Aug 18 00:57:59.662806048 (223h31m54.093886169s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.667325835 (223h31m54.098405956s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.694872563 (223h31m54.125952684s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.706685957 (223h31m54.137766088s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.741942697 (223h31m54.173022828s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.754712460 (223h31m54.185792581s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.768070369 (223h31m54.1991505s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.771281814 (223h31m54.202361945s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.792879299 (223h31m54.22395946s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.793463967 (223h31m54.224544098s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.829607052 (223h31m54.260687183s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.831966156 (223h31m54.263046287s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.883206569 (223h31m54.3142867s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910329816 (223h31m54.341409937s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910358521 (223h31m54.341438652s) [seg_pos={0 0}, upload=232481]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:57:59.910550468 (223h31m54.341630599s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910643457 (223h31m54.341723588s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection
Aug 18 00:57:59.910672562 (223h31m54.341752693s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910731685 (223h31m54.341811816s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910752546 (223h31m54.341832677s) [seg_pos={0 0}, upload=232481]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:57:59.910813522 (223h31m54.341893653s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:57:59.910818020 (223h31m54.341898151s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:58:00.375673019 (223h31m54.80675315s) [upload=232481]: Done uploading segments...
Aug 18 00:58:00.375693849 (223h31m54.80677397s) [upload=232481]: Upload finished. err: <nil>
Duration: 5.953832409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................................X...................X.X.X...] duration:
6.072627858s
FAIL (2025-08-18 01:00:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:57:57.297605729 (223h31m51.72868586s) [upload=232481]: Starting upload
Aug 18 00:57:57.297657728 (223h31m51.72873787s) [upload=232481]: Done starting upload
Aug 18 00:57:57.297727142 (223h31m51.728807273s) [upload=232481]: Uploading segments...
Aug 18 00:57:57.297968242 (223h31m51.729048373s) [upload=232481]: Got next segment. Inline: false
Aug 18 00:57:57.298014832 (223h31m51.729094963s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:57:57.298018959 (223h31m51.729099091s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:57:57.764766019 (223h31m52.19584614s) [seg_pos={0 0}, upload=232481]: Begin upload segment...
Aug 18 00:57:57.764807268 (223h31m52.195887399s) [seg_pos={0 0}, upload=232481]: Done begin upload segment.
Aug 18 00:57:57.764823368 (223h31m52.195903489s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.764833818 (223h31m52.195913959s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765173128 (223h31m52.196253259s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765466238 (223h31m52.196546369s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765741164 (223h31m52.196821295s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765998948 (223h31m52.197079079s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766242484 (223h31m52.197322615s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766481040 (223h31m52.197561161s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766791594 (223h31m52.197871725s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767033237 (223h31m52.198113368s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767229092 (223h31m52.198309223s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767563822 (223h31m52.198643963s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767766319 (223h31m52.19884644s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767953597 (223h31m52.199033728s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768174490 (223h31m52.199254621s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768413147 (223h31m52.199493278s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768666101 (223h31m52.199746232s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768850354 (223h31m52.199930485s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:59.270337793 (223h31m53.701417914s) [upload=232481]: Next returned nil segment
Aug 18 00:57:59.270354414 (223h31m53.701434545s) [upload=232481]: Waiting for error group managing segments...
Aug 18 00:57:59.662806048 (223h31m54.093886169s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.667325835 (223h31m54.098405956s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.694872563 (223h31m54.125952684s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.706685957 (223h31m54.137766088s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.741942697 (223h31m54.173022828s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.754712460 (223h31m54.185792581s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.768070369 (223h31m54.1991505s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.771281814 (223h31m54.202361945s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.792879299 (223h31m54.22395946s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.793463967 (223h31m54.224544098s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.829607052 (223h31m54.260687183s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.831966156 (223h31m54.263046287s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.883206569 (223h31m54.3142867s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910329816 (223h31m54.341409937s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910358521 (223h31m54.341438652s) [seg_pos={0 0}, upload=232481]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:57:59.910550468 (223h31m54.341630599s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910643457 (223h31m54.341723588s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection
Aug 18 00:57:59.910672562 (223h31m54.341752693s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910731685 (223h31m54.341811816s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910752546 (223h31m54.341832677s) [seg_pos={0 0}, upload=232481]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:57:59.910813522 (223h31m54.341893653s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:57:59.910818020 (223h31m54.341898151s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:58:00.375673019 (223h31m54.80675315s) [upload=232481]: Done uploading segments...
Aug 18 00:58:00.375693849 (223h31m54.80677397s) [upload=232481]: Upload finished. err: <nil>
Duration: 6.072650851s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.894197088s
FAIL (2025-08-18 00:59:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.894219399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.96494701s
FAIL (2025-08-18 00:59:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.96497271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X...................X.X.X..] duration:
6.126286539s
FAIL (2025-08-18 00:59:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:57:57.297605729 (223h31m51.72868586s) [upload=232481]: Starting upload
Aug 18 00:57:57.297657728 (223h31m51.72873787s) [upload=232481]: Done starting upload
Aug 18 00:57:57.297727142 (223h31m51.728807273s) [upload=232481]: Uploading segments...
Aug 18 00:57:57.297968242 (223h31m51.729048373s) [upload=232481]: Got next segment. Inline: false
Aug 18 00:57:57.298014832 (223h31m51.729094963s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:57:57.298018959 (223h31m51.729099091s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:57:57.764766019 (223h31m52.19584614s) [seg_pos={0 0}, upload=232481]: Begin upload segment...
Aug 18 00:57:57.764807268 (223h31m52.195887399s) [seg_pos={0 0}, upload=232481]: Done begin upload segment.
Aug 18 00:57:57.764823368 (223h31m52.195903489s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.764833818 (223h31m52.195913959s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765173128 (223h31m52.196253259s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765466238 (223h31m52.196546369s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765741164 (223h31m52.196821295s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765998948 (223h31m52.197079079s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766242484 (223h31m52.197322615s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766481040 (223h31m52.197561161s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766791594 (223h31m52.197871725s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767033237 (223h31m52.198113368s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767229092 (223h31m52.198309223s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767563822 (223h31m52.198643963s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767766319 (223h31m52.19884644s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767953597 (223h31m52.199033728s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768174490 (223h31m52.199254621s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768413147 (223h31m52.199493278s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768666101 (223h31m52.199746232s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768850354 (223h31m52.199930485s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:59.270337793 (223h31m53.701417914s) [upload=232481]: Next returned nil segment
Aug 18 00:57:59.270354414 (223h31m53.701434545s) [upload=232481]: Waiting for error group managing segments...
Aug 18 00:57:59.662806048 (223h31m54.093886169s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.667325835 (223h31m54.098405956s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.694872563 (223h31m54.125952684s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.706685957 (223h31m54.137766088s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.741942697 (223h31m54.173022828s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.754712460 (223h31m54.185792581s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.768070369 (223h31m54.1991505s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.771281814 (223h31m54.202361945s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.792879299 (223h31m54.22395946s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.793463967 (223h31m54.224544098s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.829607052 (223h31m54.260687183s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.831966156 (223h31m54.263046287s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.883206569 (223h31m54.3142867s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910329816 (223h31m54.341409937s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910358521 (223h31m54.341438652s) [seg_pos={0 0}, upload=232481]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:57:59.910550468 (223h31m54.341630599s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910643457 (223h31m54.341723588s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection
Aug 18 00:57:59.910672562 (223h31m54.341752693s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910731685 (223h31m54.341811816s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910752546 (223h31m54.341832677s) [seg_pos={0 0}, upload=232481]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:57:59.910813522 (223h31m54.341893653s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:57:59.910818020 (223h31m54.341898151s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:58:00.375673019 (223h31m54.80675315s) [upload=232481]: Done uploading segments...
Aug 18 00:58:00.375693849 (223h31m54.80677397s) [upload=232481]: Upload finished. err: <nil>
Duration: 6.126309063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................................X...................X.X.X.] duration:
5.826014977s
FAIL (2025-08-18 00:58:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:57:57.297605729 (223h31m51.72868586s) [upload=232481]: Starting upload
Aug 18 00:57:57.297657728 (223h31m51.72873787s) [upload=232481]: Done starting upload
Aug 18 00:57:57.297727142 (223h31m51.728807273s) [upload=232481]: Uploading segments...
Aug 18 00:57:57.297968242 (223h31m51.729048373s) [upload=232481]: Got next segment. Inline: false
Aug 18 00:57:57.298014832 (223h31m51.729094963s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:57:57.298018959 (223h31m51.729099091s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:57:57.764766019 (223h31m52.19584614s) [seg_pos={0 0}, upload=232481]: Begin upload segment...
Aug 18 00:57:57.764807268 (223h31m52.195887399s) [seg_pos={0 0}, upload=232481]: Done begin upload segment.
Aug 18 00:57:57.764823368 (223h31m52.195903489s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.764833818 (223h31m52.195913959s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765173128 (223h31m52.196253259s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765466238 (223h31m52.196546369s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765741164 (223h31m52.196821295s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765998948 (223h31m52.197079079s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766242484 (223h31m52.197322615s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766481040 (223h31m52.197561161s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766791594 (223h31m52.197871725s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767033237 (223h31m52.198113368s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767229092 (223h31m52.198309223s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767563822 (223h31m52.198643963s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767766319 (223h31m52.19884644s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767953597 (223h31m52.199033728s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768174490 (223h31m52.199254621s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768413147 (223h31m52.199493278s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768666101 (223h31m52.199746232s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768850354 (223h31m52.199930485s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:59.270337793 (223h31m53.701417914s) [upload=232481]: Next returned nil segment
Aug 18 00:57:59.270354414 (223h31m53.701434545s) [upload=232481]: Waiting for error group managing segments...
Aug 18 00:57:59.662806048 (223h31m54.093886169s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.667325835 (223h31m54.098405956s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.694872563 (223h31m54.125952684s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.706685957 (223h31m54.137766088s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.741942697 (223h31m54.173022828s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.754712460 (223h31m54.185792581s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.768070369 (223h31m54.1991505s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.771281814 (223h31m54.202361945s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.792879299 (223h31m54.22395946s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.793463967 (223h31m54.224544098s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.829607052 (223h31m54.260687183s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.831966156 (223h31m54.263046287s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.883206569 (223h31m54.3142867s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910329816 (223h31m54.341409937s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910358521 (223h31m54.341438652s) [seg_pos={0 0}, upload=232481]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:57:59.910550468 (223h31m54.341630599s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910643457 (223h31m54.341723588s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection
Aug 18 00:57:59.910672562 (223h31m54.341752693s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910731685 (223h31m54.341811816s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910752546 (223h31m54.341832677s) [seg_pos={0 0}, upload=232481]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:57:59.910813522 (223h31m54.341893653s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:57:59.910818020 (223h31m54.341898151s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:58:00.375673019 (223h31m54.80675315s) [upload=232481]: Done uploading segments...
Aug 18 00:58:00.375693849 (223h31m54.80677397s) [upload=232481]: Upload finished. err: <nil>
Duration: 5.826081505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.944393932s
FAIL (2025-08-18 00:58:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.944424971s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.935582022s
FAIL (2025-08-18 00:58:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.935610488s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................X...................X.X.X] duration:
4.230949943s
FAIL (2025-08-18 00:58:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:57:57.297605729 (223h31m51.72868586s) [upload=232481]: Starting upload
Aug 18 00:57:57.297657728 (223h31m51.72873787s) [upload=232481]: Done starting upload
Aug 18 00:57:57.297727142 (223h31m51.728807273s) [upload=232481]: Uploading segments...
Aug 18 00:57:57.297968242 (223h31m51.729048373s) [upload=232481]: Got next segment. Inline: false
Aug 18 00:57:57.298014832 (223h31m51.729094963s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:57:57.298018959 (223h31m51.729099091s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:57:57.764766019 (223h31m52.19584614s) [seg_pos={0 0}, upload=232481]: Begin upload segment...
Aug 18 00:57:57.764807268 (223h31m52.195887399s) [seg_pos={0 0}, upload=232481]: Done begin upload segment.
Aug 18 00:57:57.764823368 (223h31m52.195903489s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.764833818 (223h31m52.195913959s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765173128 (223h31m52.196253259s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765466238 (223h31m52.196546369s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765741164 (223h31m52.196821295s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.765998948 (223h31m52.197079079s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766242484 (223h31m52.197322615s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766481040 (223h31m52.197561161s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.766791594 (223h31m52.197871725s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767033237 (223h31m52.198113368s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767229092 (223h31m52.198309223s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767563822 (223h31m52.198643963s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767766319 (223h31m52.19884644s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.767953597 (223h31m52.199033728s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768174490 (223h31m52.199254621s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768413147 (223h31m52.199493278s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768666101 (223h31m52.199746232s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:57.768850354 (223h31m52.199930485s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Uploading piece...
Aug 18 00:57:59.270337793 (223h31m53.701417914s) [upload=232481]: Next returned nil segment
Aug 18 00:57:59.270354414 (223h31m53.701434545s) [upload=232481]: Waiting for error group managing segments...
Aug 18 00:57:59.662806048 (223h31m54.093886169s) [noise=true , address=77.90.31.10:4539 , piece_id=WPMDKROQSFHRIISWMU4YQBXRU2DQVXZWQBZSTRAPMUR2SFKYYMZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.667325835 (223h31m54.098405956s) [noise=true , address=77.90.31.19:4851 , piece_id=V2KCVIRXRYIE63VRMMOMCHAPT5PG77M23VBVMEGNVMGZTJOGEMKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.694872563 (223h31m54.125952684s) [noise=true , address=104.36.82.36:4650 , piece_id=XQ6D5J3Q7MLDWOOSCINDLHAA5656XM7BCFXIKEQLDSYXD4SBHKDA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.706685957 (223h31m54.137766088s) [noise=true , address=45.91.116.13:4176 , piece_id=ZRQOWGCKGU3RCKGHZAYZCT3OG6MH52NIWN6UX37E7P3NZWWGTRLA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.741942697 (223h31m54.173022828s) [noise=true , address=79.127.201.214:4315 , piece_id=QUJJJ3WYORW4XUHYFSTHF6Y323ZQ2VVEMWAWSTRR5OUTMRS7UG7A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.754712460 (223h31m54.185792581s) [noise=true , address=77.90.31.15:4722 , piece_id=WEBPMSLLU2IZW2OTKIMO366YPEJXJPNBC5PZ2LGXZJGVQIKQUKKA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.768070369 (223h31m54.1991505s) [noise=true , address=104.36.82.17:4340 , piece_id=74IARO3ZIDB7GZQIOTY6EUVA7KNLIBVOVBXNVJHNJFNRP6ACQGYA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.771281814 (223h31m54.202361945s) [noise=true , address=104.36.82.58:4289 , piece_id=FMKE3KLGIXMO3A422RQTY3E4RPLTW2NKYWE5RZBFSA5XWTO2HNCA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.792879299 (223h31m54.22395946s) [noise=true , address=104.36.82.59:4322 , piece_id=OTE4C3PQ5FJSO2RQIZEEHAHRATM22NTARUBVSPT7GCZ3IK4XEIDQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.793463967 (223h31m54.224544098s) [noise=true , address=77.90.31.12:4602 , piece_id=YGFUPQIZ7WUGSH4XUH7W22ECT47EWQ4AEZPZKDIWCA3P6B776WSQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.829607052 (223h31m54.260687183s) [noise=true , address=104.36.82.61:4373 , piece_id=UY6XHO2HJZRKSUNBTCK54AFNGB3NHI2LDDZ5WFMDVRJ3FOTHHN3A, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.831966156 (223h31m54.263046287s) [noise=true , address=45.91.116.7:4017 , piece_id=IA47KIF3LJO46U63RVHQ2K6XBAZUBIPCO65DNQ33AD3ES4YUGWZQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.883206569 (223h31m54.3142867s) [noise=true , address=104.36.82.36:4640 , piece_id=GXS3PRY6NDSBJYVQ744HAW3UTIDKIN2MWWKICAATNQABWIAVT27Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910329816 (223h31m54.341409937s) [noise=true , address=104.36.82.22:4541 , piece_id=HJEFK3RVYUXXBX6DQZHUJJUJNFEY4Z4PMFLVDHZWRGLIV66WTLJA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: <nil>
Aug 18 00:57:59.910358521 (223h31m54.341438652s) [seg_pos={0 0}, upload=232481]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:57:59.910550468 (223h31m54.341630599s) [noise=true , address=104.36.82.23:4446 , piece_id=ZVKIUWBNQEH4EBYEVPUXW4LZKUPHVVXOL5IKFU5IENOZSQRAP7DQ, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910643457 (223h31m54.341723588s) [noise=true , address=104.36.82.4:4815 , piece_id=XX6RNEELOOGIMV55RBUM3KZJV3Q4ILWGY3P5HSRQDMN6WXQ6LNSA, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45244->104.36.82.4:4815: use of closed network connection
Aug 18 00:57:59.910672562 (223h31m54.341752693s) [noise=true , address=104.36.82.16:4316 , piece_id=W4WOXZ76IQSGXLYZ4SHW53YT4JB2LRMR7XMDYNA2HP6XK7ZDAX7Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PPnXDzwXDVDKemw483GXuzQrPN48JJrjeeD7az2NPNawHNaXf): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910731685 (223h31m54.341811816s) [noise=true , address=77.90.31.16:4754 , piece_id=QHMVBWIKP6NHTXGEWU25PAV7I6VD3SHY2KF23P3OOOEO4XKOGU4Q, seg_pos={0 0}, upload=232481]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8): protocol: expected piece hash; context canceled; EOF
Aug 18 00:57:59.910752546 (223h31m54.341832677s) [seg_pos={0 0}, upload=232481]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:57:59.910813522 (223h31m54.341893653s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:57:59.910818020 (223h31m54.341898151s) [upload=232481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:58:00.375673019 (223h31m54.80675315s) [upload=232481]: Done uploading segments...
Aug 18 00:58:00.375693849 (223h31m54.80677397s) [upload=232481]: Upload finished. err: <nil>
Duration: 4.230973276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................X...................X.X.] duration:
5.838986824s
FAIL (2025-08-18 00:57:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:56:33.360281373 (223h30m27.791361494s) [upload=232458]: Starting upload
Aug 18 00:56:33.360367067 (223h30m27.791447198s) [upload=232458]: Done starting upload
Aug 18 00:56:33.360550428 (223h30m27.791630549s) [upload=232458]: Uploading segments...
Aug 18 00:56:33.360581778 (223h30m27.791661909s) [upload=232458]: Got next segment. Inline: false
Aug 18 00:56:33.360615053 (223h30m27.791695184s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:56:33.360619100 (223h30m27.791699221s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:56:33.833925962 (223h30m28.265006093s) [seg_pos={0 0}, upload=232458]: Begin upload segment...
Aug 18 00:56:33.833975877 (223h30m28.265056008s) [seg_pos={0 0}, upload=232458]: Done begin upload segment.
Aug 18 00:56:33.834016115 (223h30m28.265096246s) [noise=true , address=77.90.31.12:4611 , piece_id=3S5TDAOUIB2ZJW2NGCMQABTJLULDUL5BKQRHAZZ4WBUO6EOFSNWQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834050661 (223h30m28.265130802s) [noise=true , address=104.36.82.37:4684 , piece_id=4KLOH4T3KAPCTBHMEWPZLIHF4NPH2K5JCNKOSBOPXQCXBJ45IFRQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834860420 (223h30m28.265940551s) [noise=true , address=45.91.116.5:4327 , piece_id=7G6F4NRP7VK7CK33JSFHOIK2QP6YNRJ62LKKFZMSRVVLFDQES5QA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834919342 (223h30m28.265999473s) [noise=true , address=77.90.31.13:4644 , piece_id=ZDFK7KU2YX4KXQY7K5IJII7THB6IEHXAXWQGBRCVSKFLUEWGPGBA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.835391486 (223h30m28.266471607s) [noise=true , address=45.91.116.7:4026 , piece_id=RDRMQ24744LIXYA67HZQ5XK2VGBIBDT2URYWQBWM7YSUOXDI2C6Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.836141281 (223h30m28.267221412s) [noise=true , address=79.127.205.234:4590 , piece_id=M73XQG72QJVWTIMK3EAB3U3NMC7T2FGGJHAMOUVJRUNZP567QL2A, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.836362774 (223h30m28.267442905s) [noise=true , address=104.36.82.3:4782 , piece_id=MPKTTBLSRVBSGAXLEULRAMRWZKEB5EKG33YPYID33H7P37QJ6STA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.837091149 (223h30m28.26817128s) [noise=true , address=77.90.31.21:4888 , piece_id=67OFTSKOVEHUVK4YUJWWMVOQOFLCCUNP4IVAMHPBNSVY7IAG5Y5Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.837349162 (223h30m28.268429293s) [noise=true , address=104.36.82.58:4272 , piece_id=KV7LQTCLN3CTV54PKLFLJPEJ45OBV4WN7CNICLOPJNWIUIFNR74Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838024935 (223h30m28.269105066s) [noise=true , address=104.36.82.2:4744 , piece_id=AFBHXH3GDHOJISJVG5Y2YRDCIDGMYBF4P4JHGMAPKSSZDH3SKGGQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838128614 (223h30m28.269208745s) [noise=true , address=79.127.219.48:4077 , piece_id=4XOWNLXMTOWQJ3KOZN6UUWGAR2FJ4NCTC7OELR5Y577KN7O6WPRQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838490797 (223h30m28.269570928s) [noise=true , address=104.36.82.6:4889 , piece_id=HCYYC752GLHRGM4CDC7ECBMKZGLDNJIVV3N3KNKPZTV5EA45YX4Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838671612 (223h30m28.269751743s) [noise=true , address=104.36.82.18:4390 , piece_id=QKWTKEZEPV66MDFUCLXVKSA3T7ZAR4EDIF3FA74RGXJXEWCX2RPQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839201817 (223h30m28.270281948s) [noise=true , address=79.127.205.246:4283 , piece_id=V3G6TXE4XQTSRQ4WEZSTGFZOMPCA442Z76HAUKWAELSLKS5ILR6Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839489146 (223h30m28.270569267s) [noise=true , address=104.36.82.44:4897 , piece_id=ELGRWMQNQWFPHYWTMWXTER7FA2C3UM6AHPWSECKKAQJ6KLKINNUQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839745026 (223h30m28.270825157s) [noise=true , address=104.36.82.16:4299 , piece_id=NGQSZSXOIMH7OLZJNH5PARNT4ECCFNDCRZYLNFUYA7GVDF4EC5HA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.840670567 (223h30m28.271750698s) [noise=true , address=77.90.31.15:4713 , piece_id=5ZMAYH275SUHLTOJPWC7SUG6QLKBBPJIH6SGI4LJII2UT6INALLQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.845539754 (223h30m28.276619875s) [noise=true , address=66.23.193.175:4561 , piece_id=5Z5ZTQNEUD2P7YVWKFVRGBYZPTUK75FHJMKY2324VVUIN72M5WIA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:34.969396373 (223h30m29.400476495s) [upload=232458]: Next returned nil segment
Aug 18 00:56:34.969409638 (223h30m29.400489759s) [upload=232458]: Waiting for error group managing segments...
Aug 18 00:56:35.255836095 (223h30m29.686916266s) [noise=true , address=79.127.205.234:4590 , piece_id=M73XQG72QJVWTIMK3EAB3U3NMC7T2FGGJHAMOUVJRUNZP567QL2A, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.260028427 (223h30m29.691108558s) [noise=true , address=79.127.205.246:4283 , piece_id=V3G6TXE4XQTSRQ4WEZSTGFZOMPCA442Z76HAUKWAELSLKS5ILR6Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.262120109 (223h30m29.69320024s) [noise=true , address=66.23.193.175:4561 , piece_id=5Z5ZTQNEUD2P7YVWKFVRGBYZPTUK75FHJMKY2324VVUIN72M5WIA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.757488443 (223h30m30.188568574s) [noise=true , address=104.36.82.3:4782 , piece_id=MPKTTBLSRVBSGAXLEULRAMRWZKEB5EKG33YPYID33H7P37QJ6STA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.813341422 (223h30m30.244421553s) [noise=true , address=45.91.116.5:4327 , piece_id=7G6F4NRP7VK7CK33JSFHOIK2QP6YNRJ62LKKFZMSRVVLFDQES5QA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.830526243 (223h30m30.261606374s) [noise=true , address=79.127.219.48:4077 , piece_id=4XOWNLXMTOWQJ3KOZN6UUWGAR2FJ4NCTC7OELR5Y577KN7O6WPRQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.834348386 (223h30m30.265428507s) [noise=true , address=77.90.31.21:4888 , piece_id=67OFTSKOVEHUVK4YUJWWMVOQOFLCCUNP4IVAMHPBNSVY7IAG5Y5Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.842807993 (223h30m30.273888124s) [noise=true , address=104.36.82.18:4390 , piece_id=QKWTKEZEPV66MDFUCLXVKSA3T7ZAR4EDIF3FA74RGXJXEWCX2RPQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.860347422 (223h30m30.291427553s) [noise=true , address=104.36.82.6:4889 , piece_id=HCYYC752GLHRGM4CDC7ECBMKZGLDNJIVV3N3KNKPZTV5EA45YX4Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.861766858 (223h30m30.292846979s) [noise=true , address=104.36.82.2:4744 , piece_id=AFBHXH3GDHOJISJVG5Y2YRDCIDGMYBF4P4JHGMAPKSSZDH3SKGGQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.879169086 (223h30m30.310249217s) [noise=true , address=77.90.31.15:4713 , piece_id=5ZMAYH275SUHLTOJPWC7SUG6QLKBBPJIH6SGI4LJII2UT6INALLQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.886844972 (223h30m30.317925103s) [noise=true , address=77.90.31.13:4644 , piece_id=ZDFK7KU2YX4KXQY7K5IJII7THB6IEHXAXWQGBRCVSKFLUEWGPGBA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.009553242 (223h30m30.440633373s) [noise=true , address=104.36.82.16:4299 , piece_id=NGQSZSXOIMH7OLZJNH5PARNT4ECCFNDCRZYLNFUYA7GVDF4EC5HA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.059627704 (223h30m30.490707835s) [noise=true , address=104.36.82.58:4272 , piece_id=KV7LQTCLN3CTV54PKLFLJPEJ45OBV4WN7CNICLOPJNWIUIFNR74Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.059664674 (223h30m30.490744815s) [seg_pos={0 0}, upload=232458]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:56:36.059848316 (223h30m30.490928447s) [noise=true , address=45.91.116.7:4026 , piece_id=RDRMQ24744LIXYA67HZQ5XK2VGBIBDT2URYWQBWM7YSUOXDI2C6Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gTnr8AifLba6znexcCygm4oEkkedFeEHK5ztQKNH8mdiGH6E2): protocol: expected piece hash; context canceled; EOF
Aug 18 00:56:36.059893983 (223h30m30.490974114s) [noise=true , address=104.36.82.44:4897 , piece_id=ELGRWMQNQWFPHYWTMWXTER7FA2C3UM6AHPWSECKKAQJ6KLKINNUQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 18 00:56:36.060059079 (223h30m30.49113921s) [noise=true , address=77.90.31.12:4611 , piece_id=3S5TDAOUIB2ZJW2NGCMQABTJLULDUL5BKQRHAZZ4WBUO6EOFSNWQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r7qdqiUuUqsKnTXdC3S1Ek84rsCPtjPoXbPugVHWBzJezv4W2): protocol: write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection; write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection
Aug 18 00:56:36.060136778 (223h30m30.491216909s) [noise=true , address=104.36.82.37:4684 , piece_id=4KLOH4T3KAPCTBHMEWPZLIHF4NPH2K5JCNKOSBOPXQCXBJ45IFRQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123rwT3AmQR5nrvjoo6fgKBBJaKVWJHkJ6FtLnoNYs2AxakoDZC): protocol: write tcp 188.166.225.170:53038->104.36.82.37:4684: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 00:56:36.060166645 (223h30m30.491246776s) [seg_pos={0 0}, upload=232458]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:56:36.060246428 (223h30m30.491326559s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:56:36.060252099 (223h30m30.49133223s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:56:36.454916307 (223h30m30.885996438s) [upload=232458]: Done uploading segments...
Aug 18 00:56:36.454936575 (223h30m30.886016706s) [upload=232458]: Upload finished. err: <nil>
Duration: 5.839010549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.91579704s
FAIL (2025-08-18 00:57:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.915822277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X...................X.X] duration:
4.231943761s
FAIL (2025-08-18 00:56:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:56:33.360281373 (223h30m27.791361494s) [upload=232458]: Starting upload
Aug 18 00:56:33.360367067 (223h30m27.791447198s) [upload=232458]: Done starting upload
Aug 18 00:56:33.360550428 (223h30m27.791630549s) [upload=232458]: Uploading segments...
Aug 18 00:56:33.360581778 (223h30m27.791661909s) [upload=232458]: Got next segment. Inline: false
Aug 18 00:56:33.360615053 (223h30m27.791695184s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:56:33.360619100 (223h30m27.791699221s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:56:33.833925962 (223h30m28.265006093s) [seg_pos={0 0}, upload=232458]: Begin upload segment...
Aug 18 00:56:33.833975877 (223h30m28.265056008s) [seg_pos={0 0}, upload=232458]: Done begin upload segment.
Aug 18 00:56:33.834016115 (223h30m28.265096246s) [noise=true , address=77.90.31.12:4611 , piece_id=3S5TDAOUIB2ZJW2NGCMQABTJLULDUL5BKQRHAZZ4WBUO6EOFSNWQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834050661 (223h30m28.265130802s) [noise=true , address=104.36.82.37:4684 , piece_id=4KLOH4T3KAPCTBHMEWPZLIHF4NPH2K5JCNKOSBOPXQCXBJ45IFRQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834860420 (223h30m28.265940551s) [noise=true , address=45.91.116.5:4327 , piece_id=7G6F4NRP7VK7CK33JSFHOIK2QP6YNRJ62LKKFZMSRVVLFDQES5QA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.834919342 (223h30m28.265999473s) [noise=true , address=77.90.31.13:4644 , piece_id=ZDFK7KU2YX4KXQY7K5IJII7THB6IEHXAXWQGBRCVSKFLUEWGPGBA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.835391486 (223h30m28.266471607s) [noise=true , address=45.91.116.7:4026 , piece_id=RDRMQ24744LIXYA67HZQ5XK2VGBIBDT2URYWQBWM7YSUOXDI2C6Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.836141281 (223h30m28.267221412s) [noise=true , address=79.127.205.234:4590 , piece_id=M73XQG72QJVWTIMK3EAB3U3NMC7T2FGGJHAMOUVJRUNZP567QL2A, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.836362774 (223h30m28.267442905s) [noise=true , address=104.36.82.3:4782 , piece_id=MPKTTBLSRVBSGAXLEULRAMRWZKEB5EKG33YPYID33H7P37QJ6STA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.837091149 (223h30m28.26817128s) [noise=true , address=77.90.31.21:4888 , piece_id=67OFTSKOVEHUVK4YUJWWMVOQOFLCCUNP4IVAMHPBNSVY7IAG5Y5Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.837349162 (223h30m28.268429293s) [noise=true , address=104.36.82.58:4272 , piece_id=KV7LQTCLN3CTV54PKLFLJPEJ45OBV4WN7CNICLOPJNWIUIFNR74Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838024935 (223h30m28.269105066s) [noise=true , address=104.36.82.2:4744 , piece_id=AFBHXH3GDHOJISJVG5Y2YRDCIDGMYBF4P4JHGMAPKSSZDH3SKGGQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838128614 (223h30m28.269208745s) [noise=true , address=79.127.219.48:4077 , piece_id=4XOWNLXMTOWQJ3KOZN6UUWGAR2FJ4NCTC7OELR5Y577KN7O6WPRQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838490797 (223h30m28.269570928s) [noise=true , address=104.36.82.6:4889 , piece_id=HCYYC752GLHRGM4CDC7ECBMKZGLDNJIVV3N3KNKPZTV5EA45YX4Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.838671612 (223h30m28.269751743s) [noise=true , address=104.36.82.18:4390 , piece_id=QKWTKEZEPV66MDFUCLXVKSA3T7ZAR4EDIF3FA74RGXJXEWCX2RPQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839201817 (223h30m28.270281948s) [noise=true , address=79.127.205.246:4283 , piece_id=V3G6TXE4XQTSRQ4WEZSTGFZOMPCA442Z76HAUKWAELSLKS5ILR6Q, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839489146 (223h30m28.270569267s) [noise=true , address=104.36.82.44:4897 , piece_id=ELGRWMQNQWFPHYWTMWXTER7FA2C3UM6AHPWSECKKAQJ6KLKINNUQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.839745026 (223h30m28.270825157s) [noise=true , address=104.36.82.16:4299 , piece_id=NGQSZSXOIMH7OLZJNH5PARNT4ECCFNDCRZYLNFUYA7GVDF4EC5HA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.840670567 (223h30m28.271750698s) [noise=true , address=77.90.31.15:4713 , piece_id=5ZMAYH275SUHLTOJPWC7SUG6QLKBBPJIH6SGI4LJII2UT6INALLQ, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:33.845539754 (223h30m28.276619875s) [noise=true , address=66.23.193.175:4561 , piece_id=5Z5ZTQNEUD2P7YVWKFVRGBYZPTUK75FHJMKY2324VVUIN72M5WIA, seg_pos={0 0}, upload=232458]: Uploading piece...
Aug 18 00:56:34.969396373 (223h30m29.400476495s) [upload=232458]: Next returned nil segment
Aug 18 00:56:34.969409638 (223h30m29.400489759s) [upload=232458]: Waiting for error group managing segments...
Aug 18 00:56:35.255836095 (223h30m29.686916266s) [noise=true , address=79.127.205.234:4590 , piece_id=M73XQG72QJVWTIMK3EAB3U3NMC7T2FGGJHAMOUVJRUNZP567QL2A, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.260028427 (223h30m29.691108558s) [noise=true , address=79.127.205.246:4283 , piece_id=V3G6TXE4XQTSRQ4WEZSTGFZOMPCA442Z76HAUKWAELSLKS5ILR6Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.262120109 (223h30m29.69320024s) [noise=true , address=66.23.193.175:4561 , piece_id=5Z5ZTQNEUD2P7YVWKFVRGBYZPTUK75FHJMKY2324VVUIN72M5WIA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.757488443 (223h30m30.188568574s) [noise=true , address=104.36.82.3:4782 , piece_id=MPKTTBLSRVBSGAXLEULRAMRWZKEB5EKG33YPYID33H7P37QJ6STA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.813341422 (223h30m30.244421553s) [noise=true , address=45.91.116.5:4327 , piece_id=7G6F4NRP7VK7CK33JSFHOIK2QP6YNRJ62LKKFZMSRVVLFDQES5QA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.830526243 (223h30m30.261606374s) [noise=true , address=79.127.219.48:4077 , piece_id=4XOWNLXMTOWQJ3KOZN6UUWGAR2FJ4NCTC7OELR5Y577KN7O6WPRQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.834348386 (223h30m30.265428507s) [noise=true , address=77.90.31.21:4888 , piece_id=67OFTSKOVEHUVK4YUJWWMVOQOFLCCUNP4IVAMHPBNSVY7IAG5Y5Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.842807993 (223h30m30.273888124s) [noise=true , address=104.36.82.18:4390 , piece_id=QKWTKEZEPV66MDFUCLXVKSA3T7ZAR4EDIF3FA74RGXJXEWCX2RPQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.860347422 (223h30m30.291427553s) [noise=true , address=104.36.82.6:4889 , piece_id=HCYYC752GLHRGM4CDC7ECBMKZGLDNJIVV3N3KNKPZTV5EA45YX4Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.861766858 (223h30m30.292846979s) [noise=true , address=104.36.82.2:4744 , piece_id=AFBHXH3GDHOJISJVG5Y2YRDCIDGMYBF4P4JHGMAPKSSZDH3SKGGQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.879169086 (223h30m30.310249217s) [noise=true , address=77.90.31.15:4713 , piece_id=5ZMAYH275SUHLTOJPWC7SUG6QLKBBPJIH6SGI4LJII2UT6INALLQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:35.886844972 (223h30m30.317925103s) [noise=true , address=77.90.31.13:4644 , piece_id=ZDFK7KU2YX4KXQY7K5IJII7THB6IEHXAXWQGBRCVSKFLUEWGPGBA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.009553242 (223h30m30.440633373s) [noise=true , address=104.36.82.16:4299 , piece_id=NGQSZSXOIMH7OLZJNH5PARNT4ECCFNDCRZYLNFUYA7GVDF4EC5HA, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.059627704 (223h30m30.490707835s) [noise=true , address=104.36.82.58:4272 , piece_id=KV7LQTCLN3CTV54PKLFLJPEJ45OBV4WN7CNICLOPJNWIUIFNR74Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: <nil>
Aug 18 00:56:36.059664674 (223h30m30.490744815s) [seg_pos={0 0}, upload=232458]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:56:36.059848316 (223h30m30.490928447s) [noise=true , address=45.91.116.7:4026 , piece_id=RDRMQ24744LIXYA67HZQ5XK2VGBIBDT2URYWQBWM7YSUOXDI2C6Q, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gTnr8AifLba6znexcCygm4oEkkedFeEHK5ztQKNH8mdiGH6E2): protocol: expected piece hash; context canceled; EOF
Aug 18 00:56:36.059893983 (223h30m30.490974114s) [noise=true , address=104.36.82.44:4897 , piece_id=ELGRWMQNQWFPHYWTMWXTER7FA2C3UM6AHPWSECKKAQJ6KLKINNUQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 18 00:56:36.060059079 (223h30m30.49113921s) [noise=true , address=77.90.31.12:4611 , piece_id=3S5TDAOUIB2ZJW2NGCMQABTJLULDUL5BKQRHAZZ4WBUO6EOFSNWQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1r7qdqiUuUqsKnTXdC3S1Ek84rsCPtjPoXbPugVHWBzJezv4W2): protocol: write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection; write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44032->77.90.31.12:4611: use of closed network connection
Aug 18 00:56:36.060136778 (223h30m30.491216909s) [noise=true , address=104.36.82.37:4684 , piece_id=4KLOH4T3KAPCTBHMEWPZLIHF4NPH2K5JCNKOSBOPXQCXBJ45IFRQ, seg_pos={0 0}, upload=232458]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123rwT3AmQR5nrvjoo6fgKBBJaKVWJHkJ6FtLnoNYs2AxakoDZC): protocol: write tcp 188.166.225.170:53038->104.36.82.37:4684: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 18 00:56:36.060166645 (223h30m30.491246776s) [seg_pos={0 0}, upload=232458]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:56:36.060246428 (223h30m30.491326559s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:56:36.060252099 (223h30m30.49133223s) [upload=232458]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:56:36.454916307 (223h30m30.885996438s) [upload=232458]: Done uploading segments...
Aug 18 00:56:36.454936575 (223h30m30.886016706s) [upload=232458]: Upload finished. err: <nil>
Duration: 4.231978197s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.905345464s
FAIL (2025-08-18 00:56:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.905380201s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...................X.] duration:
6.135156318s
FAIL (2025-08-18 00:55:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bab78433f9db380858376692cef661ee682d57f438fe76444554b66933aef5e4 != before 355e86eafc6bee6d30f95581bd511c6ef0d3f72d6f776a253be247cf6651552a
======LOGS======
Aug 18 00:54:35.885086461 (223h28m30.316166582s) [upload=232430]: Starting upload
Aug 18 00:54:35.885131869 (223h28m30.316212s) [upload=232430]: Done starting upload
Aug 18 00:54:35.885224916 (223h28m30.316305037s) [upload=232430]: Uploading segments...
Aug 18 00:54:35.885310770 (223h28m30.316390901s) [upload=232430]: Got next segment. Inline: false
Aug 18 00:54:35.885340026 (223h28m30.316420157s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:54:35.885346048 (223h28m30.316426179s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:54:36.381070663 (223h28m30.812150795s) [seg_pos={0 0}, upload=232430]: Begin upload segment...
Aug 18 00:54:36.381129737 (223h28m30.812209868s) [seg_pos={0 0}, upload=232430]: Done begin upload segment.
Aug 18 00:54:36.381204029 (223h28m30.81228416s) [noise=true , address=66.23.193.175:4559 , piece_id=WRJXVNDKDGIN3JJYL4ZD5BKV7PB5SQRMZG4LNRQYRAKMFSRDNBOQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.381884391 (223h28m30.812964522s) [noise=true , address=104.36.82.59:4307 , piece_id=4NCEC262QTUUD7UYSKX7PKVTOZZFOSKSQERUN5BBZYZ63467AN5A, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382252375 (223h28m30.813332507s) [noise=true , address=104.36.82.43:4855 , piece_id=D6SADRXHMXHYXX7ABWKKFB3U7MMNCXE473YC5WSJRM3MPEBOQBUQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382595301 (223h28m30.813675432s) [noise=true , address=104.36.82.51:4073 , piece_id=P7JWGGLZBW76IVLDRNGGF4V5CB3L3TOCTHM33NETJDH2QVZRTU6Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382916937 (223h28m30.813997068s) [noise=true , address=79.127.219.48:4093 , piece_id=JNEG4WQ42N7OWCJYTS3K5V2KCIX36JCHASX2GPY2SZ3F2FXPXY3Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383256256 (223h28m30.814336387s) [noise=true , address=104.36.82.10:4111 , piece_id=YZAO6RBKTZZ2A34QPWCGG3N63XE55EC3IGAGG65DRURKIF2STHMA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383636894 (223h28m30.814717025s) [noise=true , address=66.23.193.175:4563 , piece_id=N7Z2RY477J5UNETVCNGIW4SGD6ICWMAVMAP7Z5IXDH2AO3LKEOZA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383962878 (223h28m30.815043009s) [noise=true , address=104.36.82.23:4449 , piece_id=GWSQWAR2FFKXUOL6NXFKQH2XNIYS6QAAFSSKKSJWX4A2ABFAQPGQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384296316 (223h28m30.815376447s) [noise=true , address=104.36.82.60:4362 , piece_id=IMRXZ3YCFVIUSPEWWFQJWZYATAQYFUUWTKZTKHJYMEBNT66U7ZHA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384648059 (223h28m30.81572819s) [noise=true , address=77.90.31.15:4705 , piece_id=I5SWAXV2K7BDNBGYUD3NCZJ6AYPH33N4U35OA65DH34QUDQRWHCA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384937383 (223h28m30.816017514s) [noise=true , address=45.91.116.7:4042 , piece_id=4NPKV3GU3N4SJJRLYROPNWBIP2NOOYA6R3RA2ZOXWNKMIW54ATXQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385266383 (223h28m30.816346514s) [noise=true , address=104.36.82.37:4669 , piece_id=BL2P3LDLRGNLPPGV2RLRPAQQSQDL5LQAP4EYJ6QY5IRKF4EIUYOA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385534505 (223h28m30.816614626s) [noise=true , address=104.36.82.2:4758 , piece_id=KQN3CWGZ4ZDPT2H7D3VSLBEKBS3LIYSK6OJVMMWZEWPJGHSK6TEQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385786286 (223h28m30.816866417s) [noise=true , address=104.36.82.36:4635 , piece_id=ZD2S5MS64MEUREUEZII2YH6JR7WTCC54BZPGGYEZ3IGAF5CBVJDQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386185992 (223h28m30.817266123s) [noise=true , address=77.90.31.18:4823 , piece_id=RHDWPDE3FHYDBV5FSWJL2W3LASAKFI2IDX2HILEXELTNWOT7EEAQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386449005 (223h28m30.817529136s) [noise=true , address=104.36.82.16:4298 , piece_id=CNZBGERVXGMV6LS4VBBHGFQIA5KJVN7TFLIY2KSZ5PGRL6B6ZD4Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386836657 (223h28m30.817916788s) [noise=true , address=104.36.82.4:4827 , piece_id=JAK5PPWRABNDPKIXB5ASLTSXG2E3OSNSK3OLOKDSVFGPOQN7FI3A, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.387176467 (223h28m30.818256598s) [noise=true , address=104.36.82.34:4572 , piece_id=KLV6VLLSSSVDDO6W5YQH5CAQQ27VAWPX3OW2G57V4Z2FNEIP72NA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:37.501745745 (223h28m31.932825877s) [upload=232430]: Next returned nil segment
Aug 18 00:54:37.501773979 (223h28m31.9328541s) [upload=232430]: Waiting for error group managing segments...
Aug 18 00:54:37.784406197 (223h28m32.215486328s) [noise=true , address=66.23.193.175:4559 , piece_id=WRJXVNDKDGIN3JJYL4ZD5BKV7PB5SQRMZG4LNRQYRAKMFSRDNBOQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:37.850328261 (223h28m32.281408392s) [noise=true , address=66.23.193.175:4563 , piece_id=N7Z2RY477J5UNETVCNGIW4SGD6ICWMAVMAP7Z5IXDH2AO3LKEOZA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.267793176 (223h28m32.698873297s) [noise=true , address=79.127.219.48:4093 , piece_id=JNEG4WQ42N7OWCJYTS3K5V2KCIX36JCHASX2GPY2SZ3F2FXPXY3Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.312284836 (223h28m32.743364957s) [noise=true , address=77.90.31.18:4823 , piece_id=RHDWPDE3FHYDBV5FSWJL2W3LASAKFI2IDX2HILEXELTNWOT7EEAQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.326445841 (223h28m32.757525972s) [noise=true , address=104.36.82.2:4758 , piece_id=KQN3CWGZ4ZDPT2H7D3VSLBEKBS3LIYSK6OJVMMWZEWPJGHSK6TEQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.347598775 (223h28m32.778678896s) [noise=true , address=104.36.82.60:4362 , piece_id=IMRXZ3YCFVIUSPEWWFQJWZYATAQYFUUWTKZTKHJYMEBNT66U7ZHA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.348076960 (223h28m32.779157091s) [noise=true , address=104.36.82.43:4855 , piece_id=D6SADRXHMXHYXX7ABWKKFB3U7MMNCXE473YC5WSJRM3MPEBOQBUQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.366484360 (223h28m32.797564491s) [noise=true , address=45.91.116.7:4042 , piece_id=4NPKV3GU3N4SJJRLYROPNWBIP2NOOYA6R3RA2ZOXWNKMIW54ATXQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.389688850 (223h28m32.820768981s) [noise=true , address=104.36.82.37:4669 , piece_id=BL2P3LDLRGNLPPGV2RLRPAQQSQDL5LQAP4EYJ6QY5IRKF4EIUYOA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.390070129 (223h28m32.82115029s) [noise=true , address=77.90.31.15:4705 , piece_id=I5SWAXV2K7BDNBGYUD3NCZJ6AYPH33N4U35OA65DH34QUDQRWHCA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.396195550 (223h28m32.827275681s) [noise=true , address=104.36.82.34:4572 , piece_id=KLV6VLLSSSVDDO6W5YQH5CAQQ27VAWPX3OW2G57V4Z2FNEIP72NA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.397078790 (223h28m32.828158931s) [noise=true , address=104.36.82.36:4635 , piece_id=ZD2S5MS64MEUREUEZII2YH6JR7WTCC54BZPGGYEZ3IGAF5CBVJDQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.446944973 (223h28m32.878025094s) [noise=true , address=104.36.82.59:4307 , piece_id=4NCEC262QTUUD7UYSKX7PKVTOZZFOSKSQERUN5BBZYZ63467AN5A, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.448204323 (223h28m32.879284454s) [noise=true , address=104.36.82.10:4111 , piece_id=YZAO6RBKTZZ2A34QPWCGG3N63XE55EC3IGAGG65DRURKIF2STHMA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.448278064 (223h28m32.879358196s) [seg_pos={0 0}, upload=232430]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:54:38.448421849 (223h28m32.87950198s) [noise=true , address=104.36.82.16:4298 , piece_id=CNZBGERVXGMV6LS4VBBHGFQIA5KJVN7TFLIY2KSZ5PGRL6B6ZD4Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sDggu72xPTG9o2K8sbPHbYfwXarrvqP98YySo7ZSEZ2ddYFEz): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448502554 (223h28m32.879582685s) [noise=true , address=104.36.82.4:4827 , piece_id=JAK5PPWRABNDPKIXB5ASLTSXG2E3OSNSK3OLOKDSVFGPOQN7FI3A, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VXFTn1urnJ2qkUcDc5785hJ8L6bNVQTtgcgNeWLaZ9wEkKYVx): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448520609 (223h28m32.87960073s) [noise=true , address=104.36.82.23:4449 , piece_id=GWSQWAR2FFKXUOL6NXFKQH2XNIYS6QAAFSSKKSJWX4A2ABFAQPGQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448568319 (223h28m32.87964845s) [noise=true , address=104.36.82.51:4073 , piece_id=P7JWGGLZBW76IVLDRNGGF4V5CB3L3TOCTHM33NETJDH2QVZRTU6Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448584410 (223h28m32.879664541s) [seg_pos={0 0}, upload=232430]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:54:38.448677699 (223h28m32.87975783s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:54:38.448681988 (223h28m32.879762109s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:54:38.759235677 (223h28m33.190315799s) [upload=232430]: Done uploading segments...
Aug 18 00:54:38.759252069 (223h28m33.19033219s) [upload=232430]: Upload finished. err: <nil>
Duration: 6.135180775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.117229482s
FAIL (2025-08-18 00:55:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 2.117255251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...................X] duration:
5.801969142s
FAIL (2025-08-18 00:54:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bab78433f9db380858376692cef661ee682d57f438fe76444554b66933aef5e4 != before 355e86eafc6bee6d30f95581bd511c6ef0d3f72d6f776a253be247cf6651552a
======LOGS======
Aug 18 00:54:35.885086461 (223h28m30.316166582s) [upload=232430]: Starting upload
Aug 18 00:54:35.885131869 (223h28m30.316212s) [upload=232430]: Done starting upload
Aug 18 00:54:35.885224916 (223h28m30.316305037s) [upload=232430]: Uploading segments...
Aug 18 00:54:35.885310770 (223h28m30.316390901s) [upload=232430]: Got next segment. Inline: false
Aug 18 00:54:35.885340026 (223h28m30.316420157s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:54:35.885346048 (223h28m30.316426179s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:54:36.381070663 (223h28m30.812150795s) [seg_pos={0 0}, upload=232430]: Begin upload segment...
Aug 18 00:54:36.381129737 (223h28m30.812209868s) [seg_pos={0 0}, upload=232430]: Done begin upload segment.
Aug 18 00:54:36.381204029 (223h28m30.81228416s) [noise=true , address=66.23.193.175:4559 , piece_id=WRJXVNDKDGIN3JJYL4ZD5BKV7PB5SQRMZG4LNRQYRAKMFSRDNBOQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.381884391 (223h28m30.812964522s) [noise=true , address=104.36.82.59:4307 , piece_id=4NCEC262QTUUD7UYSKX7PKVTOZZFOSKSQERUN5BBZYZ63467AN5A, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382252375 (223h28m30.813332507s) [noise=true , address=104.36.82.43:4855 , piece_id=D6SADRXHMXHYXX7ABWKKFB3U7MMNCXE473YC5WSJRM3MPEBOQBUQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382595301 (223h28m30.813675432s) [noise=true , address=104.36.82.51:4073 , piece_id=P7JWGGLZBW76IVLDRNGGF4V5CB3L3TOCTHM33NETJDH2QVZRTU6Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.382916937 (223h28m30.813997068s) [noise=true , address=79.127.219.48:4093 , piece_id=JNEG4WQ42N7OWCJYTS3K5V2KCIX36JCHASX2GPY2SZ3F2FXPXY3Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383256256 (223h28m30.814336387s) [noise=true , address=104.36.82.10:4111 , piece_id=YZAO6RBKTZZ2A34QPWCGG3N63XE55EC3IGAGG65DRURKIF2STHMA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383636894 (223h28m30.814717025s) [noise=true , address=66.23.193.175:4563 , piece_id=N7Z2RY477J5UNETVCNGIW4SGD6ICWMAVMAP7Z5IXDH2AO3LKEOZA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.383962878 (223h28m30.815043009s) [noise=true , address=104.36.82.23:4449 , piece_id=GWSQWAR2FFKXUOL6NXFKQH2XNIYS6QAAFSSKKSJWX4A2ABFAQPGQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384296316 (223h28m30.815376447s) [noise=true , address=104.36.82.60:4362 , piece_id=IMRXZ3YCFVIUSPEWWFQJWZYATAQYFUUWTKZTKHJYMEBNT66U7ZHA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384648059 (223h28m30.81572819s) [noise=true , address=77.90.31.15:4705 , piece_id=I5SWAXV2K7BDNBGYUD3NCZJ6AYPH33N4U35OA65DH34QUDQRWHCA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.384937383 (223h28m30.816017514s) [noise=true , address=45.91.116.7:4042 , piece_id=4NPKV3GU3N4SJJRLYROPNWBIP2NOOYA6R3RA2ZOXWNKMIW54ATXQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385266383 (223h28m30.816346514s) [noise=true , address=104.36.82.37:4669 , piece_id=BL2P3LDLRGNLPPGV2RLRPAQQSQDL5LQAP4EYJ6QY5IRKF4EIUYOA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385534505 (223h28m30.816614626s) [noise=true , address=104.36.82.2:4758 , piece_id=KQN3CWGZ4ZDPT2H7D3VSLBEKBS3LIYSK6OJVMMWZEWPJGHSK6TEQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.385786286 (223h28m30.816866417s) [noise=true , address=104.36.82.36:4635 , piece_id=ZD2S5MS64MEUREUEZII2YH6JR7WTCC54BZPGGYEZ3IGAF5CBVJDQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386185992 (223h28m30.817266123s) [noise=true , address=77.90.31.18:4823 , piece_id=RHDWPDE3FHYDBV5FSWJL2W3LASAKFI2IDX2HILEXELTNWOT7EEAQ, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386449005 (223h28m30.817529136s) [noise=true , address=104.36.82.16:4298 , piece_id=CNZBGERVXGMV6LS4VBBHGFQIA5KJVN7TFLIY2KSZ5PGRL6B6ZD4Q, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.386836657 (223h28m30.817916788s) [noise=true , address=104.36.82.4:4827 , piece_id=JAK5PPWRABNDPKIXB5ASLTSXG2E3OSNSK3OLOKDSVFGPOQN7FI3A, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:36.387176467 (223h28m30.818256598s) [noise=true , address=104.36.82.34:4572 , piece_id=KLV6VLLSSSVDDO6W5YQH5CAQQ27VAWPX3OW2G57V4Z2FNEIP72NA, seg_pos={0 0}, upload=232430]: Uploading piece...
Aug 18 00:54:37.501745745 (223h28m31.932825877s) [upload=232430]: Next returned nil segment
Aug 18 00:54:37.501773979 (223h28m31.9328541s) [upload=232430]: Waiting for error group managing segments...
Aug 18 00:54:37.784406197 (223h28m32.215486328s) [noise=true , address=66.23.193.175:4559 , piece_id=WRJXVNDKDGIN3JJYL4ZD5BKV7PB5SQRMZG4LNRQYRAKMFSRDNBOQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:37.850328261 (223h28m32.281408392s) [noise=true , address=66.23.193.175:4563 , piece_id=N7Z2RY477J5UNETVCNGIW4SGD6ICWMAVMAP7Z5IXDH2AO3LKEOZA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.267793176 (223h28m32.698873297s) [noise=true , address=79.127.219.48:4093 , piece_id=JNEG4WQ42N7OWCJYTS3K5V2KCIX36JCHASX2GPY2SZ3F2FXPXY3Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.312284836 (223h28m32.743364957s) [noise=true , address=77.90.31.18:4823 , piece_id=RHDWPDE3FHYDBV5FSWJL2W3LASAKFI2IDX2HILEXELTNWOT7EEAQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.326445841 (223h28m32.757525972s) [noise=true , address=104.36.82.2:4758 , piece_id=KQN3CWGZ4ZDPT2H7D3VSLBEKBS3LIYSK6OJVMMWZEWPJGHSK6TEQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.347598775 (223h28m32.778678896s) [noise=true , address=104.36.82.60:4362 , piece_id=IMRXZ3YCFVIUSPEWWFQJWZYATAQYFUUWTKZTKHJYMEBNT66U7ZHA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.348076960 (223h28m32.779157091s) [noise=true , address=104.36.82.43:4855 , piece_id=D6SADRXHMXHYXX7ABWKKFB3U7MMNCXE473YC5WSJRM3MPEBOQBUQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.366484360 (223h28m32.797564491s) [noise=true , address=45.91.116.7:4042 , piece_id=4NPKV3GU3N4SJJRLYROPNWBIP2NOOYA6R3RA2ZOXWNKMIW54ATXQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.389688850 (223h28m32.820768981s) [noise=true , address=104.36.82.37:4669 , piece_id=BL2P3LDLRGNLPPGV2RLRPAQQSQDL5LQAP4EYJ6QY5IRKF4EIUYOA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.390070129 (223h28m32.82115029s) [noise=true , address=77.90.31.15:4705 , piece_id=I5SWAXV2K7BDNBGYUD3NCZJ6AYPH33N4U35OA65DH34QUDQRWHCA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.396195550 (223h28m32.827275681s) [noise=true , address=104.36.82.34:4572 , piece_id=KLV6VLLSSSVDDO6W5YQH5CAQQ27VAWPX3OW2G57V4Z2FNEIP72NA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.397078790 (223h28m32.828158931s) [noise=true , address=104.36.82.36:4635 , piece_id=ZD2S5MS64MEUREUEZII2YH6JR7WTCC54BZPGGYEZ3IGAF5CBVJDQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.446944973 (223h28m32.878025094s) [noise=true , address=104.36.82.59:4307 , piece_id=4NCEC262QTUUD7UYSKX7PKVTOZZFOSKSQERUN5BBZYZ63467AN5A, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.448204323 (223h28m32.879284454s) [noise=true , address=104.36.82.10:4111 , piece_id=YZAO6RBKTZZ2A34QPWCGG3N63XE55EC3IGAGG65DRURKIF2STHMA, seg_pos={0 0}, upload=232430]: Done uploading piece. err: <nil>
Aug 18 00:54:38.448278064 (223h28m32.879358196s) [seg_pos={0 0}, upload=232430]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:54:38.448421849 (223h28m32.87950198s) [noise=true , address=104.36.82.16:4298 , piece_id=CNZBGERVXGMV6LS4VBBHGFQIA5KJVN7TFLIY2KSZ5PGRL6B6ZD4Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sDggu72xPTG9o2K8sbPHbYfwXarrvqP98YySo7ZSEZ2ddYFEz): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448502554 (223h28m32.879582685s) [noise=true , address=104.36.82.4:4827 , piece_id=JAK5PPWRABNDPKIXB5ASLTSXG2E3OSNSK3OLOKDSVFGPOQN7FI3A, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VXFTn1urnJ2qkUcDc5785hJ8L6bNVQTtgcgNeWLaZ9wEkKYVx): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448520609 (223h28m32.87960073s) [noise=true , address=104.36.82.23:4449 , piece_id=GWSQWAR2FFKXUOL6NXFKQH2XNIYS6QAAFSSKKSJWX4A2ABFAQPGQ, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448568319 (223h28m32.87964845s) [noise=true , address=104.36.82.51:4073 , piece_id=P7JWGGLZBW76IVLDRNGGF4V5CB3L3TOCTHM33NETJDH2QVZRTU6Q, seg_pos={0 0}, upload=232430]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF
Aug 18 00:54:38.448584410 (223h28m32.879664541s) [seg_pos={0 0}, upload=232430]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:54:38.448677699 (223h28m32.87975783s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:54:38.448681988 (223h28m32.879762109s) [upload=232430]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:54:38.759235677 (223h28m33.190315799s) [upload=232430]: Done uploading segments...
Aug 18 00:54:38.759252069 (223h28m33.19033219s) [upload=232430]: Upload finished. err: <nil>
Duration: 5.80200403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.765871667s
FAIL (2025-08-18 00:54:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 5.7659044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X........................................................X..] duration:
1.97063s
FAIL (2025-08-18 00:54:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.970665388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.203327294s
FAIL (2025-08-18 00:53:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.203353274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X........................................................X.] duration:
1.928062982s
FAIL (2025-08-18 00:53:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.928085956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X........................................................X] duration:
1.666522132s
FAIL (2025-08-18 00:53:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 00:53:16.546412940 (223h27m10.977493061s) [upload=232404]: Starting upload
Aug 18 00:53:16.546450632 (223h27m10.977530763s) [upload=232404]: Done starting upload
Aug 18 00:53:16.546496049 (223h27m10.97757618s) [upload=232404]: Uploading segments...
Aug 18 00:53:16.546531256 (223h27m10.977611387s) [upload=232404]: Got next segment. Inline: true
Aug 18 00:53:16.546534823 (223h27m10.977614954s) [upload=232404]: Waiting for error group managing segments...
Aug 18 00:53:16.546564761 (223h27m10.977644882s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:53:16.546568768 (223h27m10.977648889s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 00:53:16.546572075 (223h27m10.977652206s) [upload=232404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:53:16.826236503 (223h27m11.257316704s) [upload=232404]: Done uploading segments...
Aug 18 00:53:16.826254186 (223h27m11.257334317s) [upload=232404]: Upload finished. err: <nil>
Duration: 1.66654254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.986462464s
FAIL (2025-08-18 00:52:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 5.986488986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.964187492s
FAIL (2025-08-18 00:52:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964212871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.866741244s
FAIL (2025-08-18 00:52:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 5.866768485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.997898986s
FAIL (2025-08-18 00:52:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.997920807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
6.104040638s
FAIL (2025-08-18 00:51:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.104060638s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.025147662s
FAIL (2025-08-18 00:51:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.025181136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.118783365s
FAIL (2025-08-18 00:51:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.118809546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.973267697s
FAIL (2025-08-18 00:51:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.973298706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
6.29289432s
FAIL (2025-08-18 00:50:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.292916901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.935574865s
FAIL (2025-08-18 00:50:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.935601918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.072843976s
FAIL (2025-08-18 00:49:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.072869014s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.987833786s
FAIL (2025-08-18 00:49:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.987869966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
6.436791908s
FAIL (2025-08-18 00:49:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.436820512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.082651601s
FAIL (2025-08-18 00:48:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.08267698s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.879834483s
FAIL (2025-08-18 00:48:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 5.879864973s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.092726117s
FAIL (2025-08-18 00:48:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.092752567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
6.484004529s
FAIL (2025-08-18 00:47:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.484029868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..........X................................................] duration:
1.93324288s
FAIL (2025-08-18 00:47:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.933271595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..........X...............................................] duration:
2.106033128s
FAIL (2025-08-18 00:46:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.106054478s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.833169135s
FAIL (2025-08-18 00:46:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 5.833196097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.228963674s
FAIL (2025-08-18 00:45:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.228999433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..........X..............................................] duration:
2.20482765s
FAIL (2025-08-18 00:45:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.20487498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.069966129s
FAIL (2025-08-18 00:45:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.069992019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..........X.............................................] duration:
1.950148067s
FAIL (2025-08-18 00:45:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.950167024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..........X............................................] duration:
1.920340486s
FAIL (2025-08-18 00:44:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.920368579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.165640423s
FAIL (2025-08-18 00:44:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.165661443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..........X...........................................] duration:
2.055252274s
FAIL (2025-08-18 00:43:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.05527642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.425772756s
FAIL (2025-08-18 00:43:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 00:40:54.298992873 (223h14m48.730073004s) [upload=232190]: Starting upload
Aug 18 00:40:54.299068127 (223h14m48.730148258s) [upload=232190]: Done starting upload
Aug 18 00:40:54.299219396 (223h14m48.730299527s) [upload=232190]: Uploading segments...
Aug 18 00:40:54.299392888 (223h14m48.730473019s) [upload=232190]: Got next segment. Inline: false
Aug 18 00:40:54.299438635 (223h14m48.730518807s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 00:40:54.299443495 (223h14m48.730523626s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 00:40:54.774824172 (223h14m49.205904303s) [seg_pos={0 0}, upload=232190]: Begin upload segment...
Aug 18 00:40:54.774872004 (223h14m49.205952135s) [seg_pos={0 0}, upload=232190]: Done begin upload segment.
Aug 18 00:40:54.774895870 (223h14m49.205976001s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.774907021 (223h14m49.205987182s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775291907 (223h14m49.206372028s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775423159 (223h14m49.20650329s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775597251 (223h14m49.206677382s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.775859263 (223h14m49.206939394s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776141272 (223h14m49.207221404s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776444883 (223h14m49.207525014s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776716984 (223h14m49.207797115s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.776969948 (223h14m49.208050079s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777212933 (223h14m49.208293064s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777406724 (223h14m49.208486855s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777600585 (223h14m49.208680716s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.777792522 (223h14m49.208872653s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778022192 (223h14m49.209102323s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778212506 (223h14m49.209292637s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778364707 (223h14m49.209444828s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:54.778596361 (223h14m49.209676492s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Uploading piece...
Aug 18 00:40:55.996995548 (223h14m50.428075679s) [upload=232190]: Next returned nil segment
Aug 18 00:40:55.997012010 (223h14m50.428092141s) [upload=232190]: Waiting for error group managing segments...
Aug 18 00:40:56.527970132 (223h14m50.959050283s) [noise=true , address=79.127.205.246:4283 , piece_id=7EMJZQ3FQW3DLSNKOCGW7RPXATW7RLC3IKYMIXM2XIEL6XBOXKBQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.737234637 (223h14m51.168314768s) [noise=true , address=77.90.31.19:4868 , piece_id=DS4E4CF6WBCXR2CUVWLS73GKU7LDEZURPDTO2EPBP2ADHKIHR3BQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.776487232 (223h14m51.207567363s) [noise=true , address=79.127.201.215:4355 , piece_id=N45WASAQAJXSL7TKZZUD2YFVVSPHLTMJKYY4BLKXS75IOHBZERHQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.788981188 (223h14m51.220061319s) [noise=true , address=45.91.116.12:4234 , piece_id=UWAAMXM7M466AHQXTNFSFT6BD564RBLH3LE7W3VQVN5RWCZG6HMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.791234770 (223h14m51.222314901s) [noise=true , address=104.36.82.60:4358 , piece_id=BG6SLWWJTUFRGVOLPVXMROGHIM4QHCP3BHBS66BHYO2A2HADV2FA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.806660105 (223h14m51.237740236s) [noise=true , address=104.36.82.59:4332 , piece_id=GHZUVVGENYU5FMGHPZAO4ZTMA3IWOH3WSH37RELCUEPHVQABUNFA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.825984189 (223h14m51.257064311s) [noise=true , address=77.90.31.15:4728 , piece_id=KAB5DJUK2G2CZQ62A455QW4FOZZPR5DLNYFXZQNC4G5VKTULQLQA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.847755517 (223h14m51.278835648s) [noise=true , address=104.36.82.4:4807 , piece_id=ECZLJ6AZ6EBF6XDP5OQP3GGZPCV4KDO57MSEF5ARAQSLM6MSIC7A, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.849201473 (223h14m51.280281604s) [noise=true , address=77.90.31.21:4892 , piece_id=SICVBDJW6TPFI67N4JI7VRCJXZSKJKWF3L6EVDTM5WN2Q5FB7H5Q, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.851231347 (223h14m51.282311508s) [noise=true , address=104.36.82.19:4410 , piece_id=S4VH5EZDJWDBCDAALZP67KAQGJ6FH7OIWZQIAOXAN4CJXREYLRWQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.855873660 (223h14m51.286953791s) [noise=true , address=104.36.82.38:4694 , piece_id=C3KDPRXW2P2QLV7JDFVXXVWQETTKVT7YPFKHCUYJF6ZRDVT2FHMQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.867312858 (223h14m51.298392979s) [noise=true , address=104.36.82.40:4941 , piece_id=X6HFWIXZX2ZSXUKXGK3GQ26BSYCXOBKI37U5U5RTSTUF3HZGZZPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:56.884896131 (223h14m51.315976262s) [noise=true , address=104.36.82.61:4407 , piece_id=G2L6U3N3BY3JU4LFKEQ6G2ME4O45D7HHCJJUXFJZBRV2D6SGIKWA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060115715 (223h14m51.491195846s) [noise=true , address=104.36.82.34:4568 , piece_id=7AKQR3LMW2PLRRSCKRXBDFOYPSQWHVI4FQV7CVKQWO3QI27BP4OQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: <nil>
Aug 18 00:40:57.060148828 (223h14m51.491228959s) [seg_pos={0 0}, upload=232190]: Segment reached optimal threshold of 14 pieces.
Aug 18 00:40:57.060417252 (223h14m51.491497383s) [noise=true , address=104.36.82.13:4218 , piece_id=3BU7UGDWXU2LFGVVF7GPB54MBLFRRX75LNSJDSROX2GJXII46DTQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060505611 (223h14m51.491585742s) [noise=true , address=104.36.82.10:4081 , piece_id=OCZNUDZECW7UR7UWZOYYFELCHVXCNOFMFEUO2QWARZIPE36WAFDA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 18 00:40:57.060602746 (223h14m51.491682877s) [noise=true , address=104.36.82.5:4844 , piece_id=QOWCD5BANW7AN7VNNHFODYKO6TAC6LGJHVAY7HB4JXLHBYIIDOPQ, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51554->104.36.82.5:4844: use of closed network connection
Aug 18 00:40:57.060615642 (223h14m51.491695773s) [noise=true , address=77.90.31.18:4834 , piece_id=2OF4RK6YDTO4W7P66H2GIEDQ5PTRJGOBLRQEYLCOTGSD2KINZKSA, seg_pos={0 0}, upload=232190]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q): protocol: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51512->77.90.31.18:4834: use of closed network connection
Aug 18 00:40:57.060673883 (223h14m51.491754034s) [seg_pos={0 0}, upload=232190]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 00:40:57.060769687 (223h14m51.491849838s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 00:40:57.060775688 (223h14m51.491855829s) [upload=232190]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 00:40:57.621965373 (223h14m52.053045504s) [upload=232190]: Done uploading segments...
Aug 18 00:40:57.621988277 (223h14m52.053068408s) [upload=232190]: Upload finished. err: <nil>
Duration: 6.42579568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..........X..........................................] duration:
1.902977758s
FAIL (2025-08-18 00:43:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.903023764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|