Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X................X............X..........................] duration: 2.168141365s FAIL (2025-08-11 14:43:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 2.168164778s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........................X.X...X..X.....X.X...........X....] duration: 6.264406863s FAIL (2025-08-11 14:43:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:40:16.092197730 (69h14m10.523277862s) [upload=72162]: Starting upload Aug 11 14:40:16.092243939 (69h14m10.52332407s) [upload=72162]: Done starting upload Aug 11 14:40:16.092335424 (69h14m10.523415555s) [upload=72162]: Uploading segments... Aug 11 14:40:16.092499087 (69h14m10.523579208s) [upload=72162]: Got next segment. Inline: false Aug 11 14:40:16.092539033 (69h14m10.523619164s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:40:16.092545356 (69h14m10.523625487s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:40:16.617334774 (69h14m11.048414915s) [seg_pos={0 0}, upload=72162]: Begin upload segment... Aug 11 14:40:16.617379469 (69h14m11.048459601s) [seg_pos={0 0}, upload=72162]: Done begin upload segment. Aug 11 14:40:16.617385521 (69h14m11.048465652s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.617394808 (69h14m11.048474939s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618115737 (69h14m11.049195888s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618717850 (69h14m11.049798001s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618776441 (69h14m11.049856573s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619129567 (69h14m11.050209698s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619141571 (69h14m11.050221702s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619507451 (69h14m11.050587592s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619514784 (69h14m11.050594915s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619871617 (69h14m11.050951748s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620200056 (69h14m11.051280187s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620542080 (69h14m11.051622212s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620650388 (69h14m11.051730529s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620952526 (69h14m11.052032657s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621239174 (69h14m11.052319305s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621501967 (69h14m11.052582098s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621845464 (69h14m11.052925595s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.622058702 (69h14m11.053138833s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:18.168740621 (69h14m12.599820752s) [upload=72162]: Next returned nil segment Aug 11 14:40:18.168784144 (69h14m12.599864275s) [upload=72162]: Waiting for error group managing segments... Aug 11 14:40:18.584808444 (69h14m13.015888575s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.682249736 (69h14m13.113329867s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.720106611 (69h14m13.151186742s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.776832729 (69h14m13.20791286s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.835316409 (69h14m13.266396541s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.855111845 (69h14m13.286191976s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.874879048 (69h14m13.305959179s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.894904985 (69h14m13.325985126s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.096291513 (69h14m13.527371644s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.658637210 (69h14m14.089717341s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.842116143 (69h14m14.273196264s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.899915175 (69h14m14.330995306s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.901859566 (69h14m14.332939697s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060236540 (69h14m14.491316661s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060261909 (69h14m14.49134204s) [seg_pos={0 0}, upload=72162]: Segment reached optimal threshold of 14 pieces. Aug 11 14:40:20.060373673 (69h14m14.491453804s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060673577 (69h14m14.491753708s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060761805 (69h14m14.491841936s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f): protocol: rpc: dial tcp 104.36.82.34:4570: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 14:40:20.060939585 (69h14m14.492019716s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psFkYiShywfFT2fRu8CWkzXbzBZBH5JvZbtxkhpmFCfhFkX4W): protocol: write tcp 188.166.225.170:53856->104.36.82.43:4853: use of closed network connection; context canceled Aug 11 14:40:20.060958311 (69h14m14.492038442s) [seg_pos={0 0}, upload=72162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:40:20.061050477 (69h14m14.492130608s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:40:20.061069654 (69h14m14.492149775s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:40:20.467794350 (69h14m14.898874531s) [upload=72162]: Done uploading segments... Aug 11 14:40:20.467814970 (69h14m14.898895101s) [upload=72162]: Upload finished. err: <nil> Duration: 6.2644313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X................X............X.........................] duration: 1.929128352s FAIL (2025-08-11 14:42:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.929163368s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........................X.X...X..X.....X.X...........X...] duration: 7.276423478s FAIL (2025-08-11 14:42:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:40:16.092197730 (69h14m10.523277862s) [upload=72162]: Starting upload Aug 11 14:40:16.092243939 (69h14m10.52332407s) [upload=72162]: Done starting upload Aug 11 14:40:16.092335424 (69h14m10.523415555s) [upload=72162]: Uploading segments... Aug 11 14:40:16.092499087 (69h14m10.523579208s) [upload=72162]: Got next segment. Inline: false Aug 11 14:40:16.092539033 (69h14m10.523619164s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:40:16.092545356 (69h14m10.523625487s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:40:16.617334774 (69h14m11.048414915s) [seg_pos={0 0}, upload=72162]: Begin upload segment... Aug 11 14:40:16.617379469 (69h14m11.048459601s) [seg_pos={0 0}, upload=72162]: Done begin upload segment. Aug 11 14:40:16.617385521 (69h14m11.048465652s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.617394808 (69h14m11.048474939s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618115737 (69h14m11.049195888s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618717850 (69h14m11.049798001s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618776441 (69h14m11.049856573s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619129567 (69h14m11.050209698s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619141571 (69h14m11.050221702s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619507451 (69h14m11.050587592s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619514784 (69h14m11.050594915s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619871617 (69h14m11.050951748s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620200056 (69h14m11.051280187s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620542080 (69h14m11.051622212s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620650388 (69h14m11.051730529s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620952526 (69h14m11.052032657s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621239174 (69h14m11.052319305s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621501967 (69h14m11.052582098s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621845464 (69h14m11.052925595s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.622058702 (69h14m11.053138833s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:18.168740621 (69h14m12.599820752s) [upload=72162]: Next returned nil segment Aug 11 14:40:18.168784144 (69h14m12.599864275s) [upload=72162]: Waiting for error group managing segments... Aug 11 14:40:18.584808444 (69h14m13.015888575s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.682249736 (69h14m13.113329867s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.720106611 (69h14m13.151186742s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.776832729 (69h14m13.20791286s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.835316409 (69h14m13.266396541s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.855111845 (69h14m13.286191976s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.874879048 (69h14m13.305959179s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.894904985 (69h14m13.325985126s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.096291513 (69h14m13.527371644s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.658637210 (69h14m14.089717341s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.842116143 (69h14m14.273196264s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.899915175 (69h14m14.330995306s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.901859566 (69h14m14.332939697s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060236540 (69h14m14.491316661s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060261909 (69h14m14.49134204s) [seg_pos={0 0}, upload=72162]: Segment reached optimal threshold of 14 pieces. Aug 11 14:40:20.060373673 (69h14m14.491453804s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060673577 (69h14m14.491753708s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060761805 (69h14m14.491841936s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f): protocol: rpc: dial tcp 104.36.82.34:4570: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 14:40:20.060939585 (69h14m14.492019716s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psFkYiShywfFT2fRu8CWkzXbzBZBH5JvZbtxkhpmFCfhFkX4W): protocol: write tcp 188.166.225.170:53856->104.36.82.43:4853: use of closed network connection; context canceled Aug 11 14:40:20.060958311 (69h14m14.492038442s) [seg_pos={0 0}, upload=72162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:40:20.061050477 (69h14m14.492130608s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:40:20.061069654 (69h14m14.492149775s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:40:20.467794350 (69h14m14.898874531s) [upload=72162]: Done uploading segments... Aug 11 14:40:20.467814970 (69h14m14.898895101s) [upload=72162]: Upload finished. err: <nil> Duration: 7.276453154s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.830414814s FAIL (2025-08-11 14:42:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.830432438s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 8.535923079s FAIL (2025-08-11 14:41:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.535952485s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [............................X.X...X..X.....X.X...........X..] duration: 6.461429365s FAIL (2025-08-11 14:41:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:40:16.092197730 (69h14m10.523277862s) [upload=72162]: Starting upload Aug 11 14:40:16.092243939 (69h14m10.52332407s) [upload=72162]: Done starting upload Aug 11 14:40:16.092335424 (69h14m10.523415555s) [upload=72162]: Uploading segments... Aug 11 14:40:16.092499087 (69h14m10.523579208s) [upload=72162]: Got next segment. Inline: false Aug 11 14:40:16.092539033 (69h14m10.523619164s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:40:16.092545356 (69h14m10.523625487s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:40:16.617334774 (69h14m11.048414915s) [seg_pos={0 0}, upload=72162]: Begin upload segment... Aug 11 14:40:16.617379469 (69h14m11.048459601s) [seg_pos={0 0}, upload=72162]: Done begin upload segment. Aug 11 14:40:16.617385521 (69h14m11.048465652s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.617394808 (69h14m11.048474939s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618115737 (69h14m11.049195888s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618717850 (69h14m11.049798001s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618776441 (69h14m11.049856573s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619129567 (69h14m11.050209698s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619141571 (69h14m11.050221702s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619507451 (69h14m11.050587592s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619514784 (69h14m11.050594915s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619871617 (69h14m11.050951748s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620200056 (69h14m11.051280187s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620542080 (69h14m11.051622212s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620650388 (69h14m11.051730529s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620952526 (69h14m11.052032657s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621239174 (69h14m11.052319305s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621501967 (69h14m11.052582098s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621845464 (69h14m11.052925595s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.622058702 (69h14m11.053138833s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:18.168740621 (69h14m12.599820752s) [upload=72162]: Next returned nil segment Aug 11 14:40:18.168784144 (69h14m12.599864275s) [upload=72162]: Waiting for error group managing segments... Aug 11 14:40:18.584808444 (69h14m13.015888575s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.682249736 (69h14m13.113329867s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.720106611 (69h14m13.151186742s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.776832729 (69h14m13.20791286s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.835316409 (69h14m13.266396541s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.855111845 (69h14m13.286191976s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.874879048 (69h14m13.305959179s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.894904985 (69h14m13.325985126s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.096291513 (69h14m13.527371644s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.658637210 (69h14m14.089717341s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.842116143 (69h14m14.273196264s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.899915175 (69h14m14.330995306s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.901859566 (69h14m14.332939697s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060236540 (69h14m14.491316661s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060261909 (69h14m14.49134204s) [seg_pos={0 0}, upload=72162]: Segment reached optimal threshold of 14 pieces. Aug 11 14:40:20.060373673 (69h14m14.491453804s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060673577 (69h14m14.491753708s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060761805 (69h14m14.491841936s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f): protocol: rpc: dial tcp 104.36.82.34:4570: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 14:40:20.060939585 (69h14m14.492019716s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psFkYiShywfFT2fRu8CWkzXbzBZBH5JvZbtxkhpmFCfhFkX4W): protocol: write tcp 188.166.225.170:53856->104.36.82.43:4853: use of closed network connection; context canceled Aug 11 14:40:20.060958311 (69h14m14.492038442s) [seg_pos={0 0}, upload=72162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:40:20.061050477 (69h14m14.492130608s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:40:20.061069654 (69h14m14.492149775s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:40:20.467794350 (69h14m14.898874531s) [upload=72162]: Done uploading segments... Aug 11 14:40:20.467814970 (69h14m14.898895101s) [upload=72162]: Upload finished. err: <nil> Duration: 6.461458111s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X................X............X........................] duration: 1.85016692s FAIL (2025-08-11 14:41:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.850190454s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 7.387051397s FAIL (2025-08-11 14:41:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.387072798s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X................X............X.......................] duration: 1.824527203s FAIL (2025-08-11 14:41:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.824559665s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.............................X.X...X..X.....X.X...........X.] duration: 6.197890959s FAIL (2025-08-11 14:41:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:40:16.092197730 (69h14m10.523277862s) [upload=72162]: Starting upload Aug 11 14:40:16.092243939 (69h14m10.52332407s) [upload=72162]: Done starting upload Aug 11 14:40:16.092335424 (69h14m10.523415555s) [upload=72162]: Uploading segments... Aug 11 14:40:16.092499087 (69h14m10.523579208s) [upload=72162]: Got next segment. Inline: false Aug 11 14:40:16.092539033 (69h14m10.523619164s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:40:16.092545356 (69h14m10.523625487s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:40:16.617334774 (69h14m11.048414915s) [seg_pos={0 0}, upload=72162]: Begin upload segment... Aug 11 14:40:16.617379469 (69h14m11.048459601s) [seg_pos={0 0}, upload=72162]: Done begin upload segment. Aug 11 14:40:16.617385521 (69h14m11.048465652s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.617394808 (69h14m11.048474939s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618115737 (69h14m11.049195888s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618717850 (69h14m11.049798001s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618776441 (69h14m11.049856573s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619129567 (69h14m11.050209698s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619141571 (69h14m11.050221702s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619507451 (69h14m11.050587592s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619514784 (69h14m11.050594915s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619871617 (69h14m11.050951748s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620200056 (69h14m11.051280187s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620542080 (69h14m11.051622212s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620650388 (69h14m11.051730529s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620952526 (69h14m11.052032657s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621239174 (69h14m11.052319305s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621501967 (69h14m11.052582098s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621845464 (69h14m11.052925595s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.622058702 (69h14m11.053138833s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:18.168740621 (69h14m12.599820752s) [upload=72162]: Next returned nil segment Aug 11 14:40:18.168784144 (69h14m12.599864275s) [upload=72162]: Waiting for error group managing segments... Aug 11 14:40:18.584808444 (69h14m13.015888575s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.682249736 (69h14m13.113329867s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.720106611 (69h14m13.151186742s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.776832729 (69h14m13.20791286s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.835316409 (69h14m13.266396541s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.855111845 (69h14m13.286191976s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.874879048 (69h14m13.305959179s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.894904985 (69h14m13.325985126s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.096291513 (69h14m13.527371644s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.658637210 (69h14m14.089717341s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.842116143 (69h14m14.273196264s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.899915175 (69h14m14.330995306s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.901859566 (69h14m14.332939697s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060236540 (69h14m14.491316661s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060261909 (69h14m14.49134204s) [seg_pos={0 0}, upload=72162]: Segment reached optimal threshold of 14 pieces. Aug 11 14:40:20.060373673 (69h14m14.491453804s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060673577 (69h14m14.491753708s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060761805 (69h14m14.491841936s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f): protocol: rpc: dial tcp 104.36.82.34:4570: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 14:40:20.060939585 (69h14m14.492019716s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psFkYiShywfFT2fRu8CWkzXbzBZBH5JvZbtxkhpmFCfhFkX4W): protocol: write tcp 188.166.225.170:53856->104.36.82.43:4853: use of closed network connection; context canceled Aug 11 14:40:20.060958311 (69h14m14.492038442s) [seg_pos={0 0}, upload=72162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:40:20.061050477 (69h14m14.492130608s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:40:20.061069654 (69h14m14.492149775s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:40:20.467794350 (69h14m14.898874531s) [upload=72162]: Done uploading segments... Aug 11 14:40:20.467814970 (69h14m14.898895101s) [upload=72162]: Upload finished. err: <nil> Duration: 6.197916006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 7.209179772s FAIL (2025-08-11 14:40:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.20923525s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..............................X.X...X..X.....X.X...........X] duration: 5.479077652s FAIL (2025-08-11 14:40:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:40:16.092197730 (69h14m10.523277862s) [upload=72162]: Starting upload Aug 11 14:40:16.092243939 (69h14m10.52332407s) [upload=72162]: Done starting upload Aug 11 14:40:16.092335424 (69h14m10.523415555s) [upload=72162]: Uploading segments... Aug 11 14:40:16.092499087 (69h14m10.523579208s) [upload=72162]: Got next segment. Inline: false Aug 11 14:40:16.092539033 (69h14m10.523619164s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:40:16.092545356 (69h14m10.523625487s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:40:16.617334774 (69h14m11.048414915s) [seg_pos={0 0}, upload=72162]: Begin upload segment... Aug 11 14:40:16.617379469 (69h14m11.048459601s) [seg_pos={0 0}, upload=72162]: Done begin upload segment. Aug 11 14:40:16.617385521 (69h14m11.048465652s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.617394808 (69h14m11.048474939s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618115737 (69h14m11.049195888s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618717850 (69h14m11.049798001s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.618776441 (69h14m11.049856573s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619129567 (69h14m11.050209698s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619141571 (69h14m11.050221702s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619507451 (69h14m11.050587592s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619514784 (69h14m11.050594915s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.619871617 (69h14m11.050951748s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620200056 (69h14m11.051280187s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620542080 (69h14m11.051622212s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620650388 (69h14m11.051730529s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.620952526 (69h14m11.052032657s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621239174 (69h14m11.052319305s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621501967 (69h14m11.052582098s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.621845464 (69h14m11.052925595s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:16.622058702 (69h14m11.053138833s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Uploading piece... Aug 11 14:40:18.168740621 (69h14m12.599820752s) [upload=72162]: Next returned nil segment Aug 11 14:40:18.168784144 (69h14m12.599864275s) [upload=72162]: Waiting for error group managing segments... Aug 11 14:40:18.584808444 (69h14m13.015888575s) [noise=true , address=104.36.82.22:4516 , piece_id=IIUBML2LNXCMKIMIFYRZDMIEFNA3OQBODKFTVLC7CZVNMQ7B35PA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.682249736 (69h14m13.113329867s) [noise=true , address=104.36.82.62:4444 , piece_id=CTQ27E6XLNKG3KVUAPSUFC2SA3R2H7KJBL6APLBHXLV2MIXXSQPA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.720106611 (69h14m13.151186742s) [noise=true , address=104.36.82.45:4914 , piece_id=GIWPMCQ4JPCHMARO2QG4R7OAEEBMVQ3NMVMHR6NHIB6MFTWSUHNA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.776832729 (69h14m13.20791286s) [noise=true , address=104.36.82.44:4899 , piece_id=NRVN5TOXQIAL75YZQ3AEW7RL37SQOZSRZXK7G5AUZ4RL4YLLPPFA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.835316409 (69h14m13.266396541s) [noise=true , address=64.49.13.26:4948 , piece_id=IRAMCPRQIQHFFCXQ4FQLN76Y4LYJK3YCAADBBYBGMTVPHRO2MJSA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.855111845 (69h14m13.286191976s) [noise=true , address=104.36.82.13:4192 , piece_id=LDYF67KGAEB5HETLHC6M3UW3MG4T7EKYKTEIMQOEEW7GS7Q7ONGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.874879048 (69h14m13.305959179s) [noise=true , address=64.49.13.169:4709 , piece_id=FI5BXWKCK6Y5KCI3FCDFOGZKQ3WCWJPXU6ACOLEIVVM3BDKYFVYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:18.894904985 (69h14m13.325985126s) [noise=true , address=104.36.82.61:4383 , piece_id=XBY34QDD6KPDUL7TBXKUPK663IVGTHSWQQJMDOVTDQELMSTNLMTQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.096291513 (69h14m13.527371644s) [noise=true , address=104.36.82.36:4646 , piece_id=JZ3ET2U65EOHJFFTE5SYSKVVIDY5FBSEJTZ4KLADNSRAK36YQN6Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.658637210 (69h14m14.089717341s) [noise=true , address=104.36.82.58:4272 , piece_id=S67YKAPCXSSZ6PPODMYWRCXRULIB2W3PG3MYYQQ5BEADVLJVFBOA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.842116143 (69h14m14.273196264s) [noise=true , address=104.36.82.60:4351 , piece_id=7XGHLJL7NGTEP3VYUP6YTNGGTEKOXIXPEHPUH43LOFIAAV4BOJGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.899915175 (69h14m14.330995306s) [noise=true , address=104.36.82.23:4458 , piece_id=DE5IA5WWUHMWHVFLNU6XKGLML65PKHS3F23IXAKS3YUYEA6PSIIQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:19.901859566 (69h14m14.332939697s) [noise=true , address=77.90.31.19:4859 , piece_id=PPR4AQS5BKTVBJW7F3ZLHMJNA3W2BCBSWSWGOH6OTBVLYYS4BMEA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060236540 (69h14m14.491316661s) [noise=true , address=104.36.82.38:4720 , piece_id=56QLWK4OZY2ZHN2XIHZY7ZKS4GVXSIS6XCSMG4OJHTSQ7AUN7DYA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: <nil> Aug 11 14:40:20.060261909 (69h14m14.49134204s) [seg_pos={0 0}, upload=72162]: Segment reached optimal threshold of 14 pieces. Aug 11 14:40:20.060373673 (69h14m14.491453804s) [noise=true , address=104.36.82.37:4676 , piece_id=467LTEP3UC4HJU6FOMECXIOXEZ4GBLVXQY4FCXXN5X3J7TGGLKGA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060673577 (69h14m14.491753708s) [noise=true , address=77.90.31.18:4809 , piece_id=B5WEVZA4JDPRTIBZR62MPIVYTZJS2QYC2JTR2V4467S2WTQYXD3Q, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF Aug 11 14:40:20.060761805 (69h14m14.491841936s) [noise=true , address=104.36.82.34:4570 , piece_id=CJ4P25SPJUKRYEV4WZIX66NDUBI5NEAPY2TOFJS3YLG3ZQPULXUA, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FX9wGFEYh96uNsKZLGCNRvEGLCmSmcG8a5HxU67yUU6eT1W4f): protocol: rpc: dial tcp 104.36.82.34:4570: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 14:40:20.060939585 (69h14m14.492019716s) [noise=true , address=104.36.82.43:4853 , piece_id=2G5Z4IAUDC5FJ224JAVKP2WDA5D4LPPOJNZDVWCBX7JGOELRAEUQ, seg_pos={0 0}, upload=72162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psFkYiShywfFT2fRu8CWkzXbzBZBH5JvZbtxkhpmFCfhFkX4W): protocol: write tcp 188.166.225.170:53856->104.36.82.43:4853: use of closed network connection; context canceled Aug 11 14:40:20.060958311 (69h14m14.492038442s) [seg_pos={0 0}, upload=72162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:40:20.061050477 (69h14m14.492130608s) [upload=72162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:40:20.061069654 (69h14m14.492149775s) [upload=72162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:40:20.467794350 (69h14m14.898874531s) [upload=72162]: Done uploading segments... Aug 11 14:40:20.467814970 (69h14m14.898895101s) [upload=72162]: Upload finished. err: <nil> Duration: 5.479102661s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X......X................X............X......................] duration: 1.860980581s FAIL (2025-08-11 14:40:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.860996562s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [X..............................X.X...X..X.....X.X...........] duration: 11.56064239s FAIL (2025-08-11 14:39:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 11.560667047s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X......X................X............X.....................] duration: 1.842720832s FAIL (2025-08-11 14:39:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.842749196s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.510629694s FAIL (2025-08-11 14:39:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.510653882s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X......X................X............X....................] duration: 1.872417023s FAIL (2025-08-11 14:39:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.872444395s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.X..............................X.X...X..X.....X.X..........] duration: 7.21291228s FAIL (2025-08-11 14:38:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 7.212940252s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.34485691s FAIL (2025-08-11 14:38:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.344875094s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X......X................X............X...................] duration: 1.979154484s FAIL (2025-08-11 14:38:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.979183389s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..X..............................X.X...X..X.....X.X.........] duration: 6.627532775s FAIL (2025-08-11 14:38:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.627560849s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.187415096s FAIL (2025-08-11 14:37:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.187436266s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X......X................X............X..................] duration: 2.449184825s FAIL (2025-08-11 14:37:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 2.449217758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...X..............................X.X...X..X.....X.X........] duration: 6.514084788s FAIL (2025-08-11 14:37:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.514107402s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.161129537s FAIL (2025-08-11 14:37:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.161150036s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [....X..............................X.X...X..X.....X.X.......] duration: 6.929186025s FAIL (2025-08-11 14:36:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.929213829s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X......X................X............X.................] duration: 1.823559305s FAIL (2025-08-11 14:36:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.823590215s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 7.001623092s FAIL (2025-08-11 14:36:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.001647018s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....X..............................X.X...X..X.....X.X......] duration: 6.469405615s FAIL (2025-08-11 14:36:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.469427166s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X......X................X............X................] duration: 1.990477682s FAIL (2025-08-11 14:36:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.990509591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [......X..............................X.X...X..X.....X.X.....] duration: 6.54214837s FAIL (2025-08-11 14:35:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.542170964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 9.971377015s FAIL (2025-08-11 14:35:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.971400832s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......X..............................X.X...X..X.....X.X....] duration: 6.389951667s FAIL (2025-08-11 14:35:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.389973057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.129784735s FAIL (2025-08-11 14:35:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.129808382s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X......X................X............X...............] duration: 1.863518761s FAIL (2025-08-11 14:35:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.863541877s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 7.699328086s FAIL (2025-08-11 14:34:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.69935092s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [........X..............................X.X...X..X.....X.X...] duration: 6.075989227s FAIL (2025-08-11 14:34:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.07603308s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X......X................X............X..............] duration: 2.006204252s FAIL (2025-08-11 14:34:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 2.006231523s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 9.571344617s FAIL (2025-08-11 14:34:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.571365147s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [.........X..............................X.X...X..X.....X.X..] duration: 6.148363316s FAIL (2025-08-11 14:34:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 6.148394055s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [..........X..............................X.X...X..X.....X.X.] duration: 5.987935335s FAIL (2025-08-11 14:33:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 5.987965825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X......X................X............X.............] duration: 1.973272972s FAIL (2025-08-11 14:33:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 1.973295615s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.663608474s FAIL (2025-08-11 14:33:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.663630045s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........X..............................X.X...X..X.....X.X] duration: 7.851462917s FAIL (2025-08-11 14:33:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:32:59.468915953 (69h6m53.899996084s) [upload=72033]: Starting upload Aug 11 14:32:59.468962052 (69h6m53.900042183s) [upload=72033]: Done starting upload Aug 11 14:32:59.469081089 (69h6m53.90016122s) [upload=72033]: Uploading segments... Aug 11 14:32:59.469174147 (69h6m53.900254278s) [upload=72033]: Got next segment. Inline: false Aug 11 14:32:59.469221428 (69h6m53.900301559s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:32:59.469226166 (69h6m53.900306297s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:33:02.017256893 (69h6m56.448337044s) [seg_pos={0 0}, upload=72033]: Begin upload segment... Aug 11 14:33:02.017339140 (69h6m56.448419271s) [seg_pos={0 0}, upload=72033]: Done begin upload segment. Aug 11 14:33:02.017368286 (69h6m56.448448417s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017384386 (69h6m56.448464517s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.017988322 (69h6m56.449068453s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018418375 (69h6m56.449498506s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018763305 (69h6m56.449843446s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.018909635 (69h6m56.449989776s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019109457 (69h6m56.450189588s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019252091 (69h6m56.450332222s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019447955 (69h6m56.450528096s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019591299 (69h6m56.45067144s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019787895 (69h6m56.450868036s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.019944034 (69h6m56.451024175s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020106145 (69h6m56.451186286s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020270048 (69h6m56.451350189s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020513304 (69h6m56.451593435s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020695081 (69h6m56.451775222s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.020839417 (69h6m56.451919548s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:02.021057835 (69h6m56.452137976s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Uploading piece... Aug 11 14:33:03.210474634 (69h6m57.641554765s) [upload=72033]: Next returned nil segment Aug 11 14:33:03.210495464 (69h6m57.641575596s) [upload=72033]: Waiting for error group managing segments... Aug 11 14:33:03.611452802 (69h6m58.042532963s) [noise=true , address=64.49.13.139:4479 , piece_id=R7UI7MUFPSLS6I2ZQ2OXNVNW5TVTERSXAFJF357NJ35UNGTL3DSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.073705420 (69h6m58.504785551s) [noise=true , address=104.36.82.34:4558 , piece_id=43LFHSR23QKC5JAB2XI4LDJXWDTKISUCDWVRY5F4NF75RRGN3EYA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.127752672 (69h6m58.558832793s) [noise=true , address=104.36.82.47:4533 , piece_id=XUI2LCUH73EZ4ZWOBYER6YNTXMPL5J2CKLH7VTZ5SBR4MXXRDSTQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.161026467 (69h6m58.592106598s) [noise=true , address=104.36.82.44:4883 , piece_id=ACHJYEOAOHLIYGY7D2E73IJKIKGRFVSBK74RV6GKU2HXZU267V5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.171914039 (69h6m58.60299417s) [noise=true , address=104.36.82.13:4188 , piece_id=3XRPDKPUR72YVOONHZOTZMVOOT7MPNP3EUN7MKPVVGVTIZ7OQQDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.205074497 (69h6m58.636154628s) [noise=true , address=104.36.82.53:4125 , piece_id=TIYGDXLM4FSJ7A5Y3SZE5XDVJ7MZ73R343FPCFEEHDME4V6EM7MA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.347000814 (69h6m58.778080935s) [noise=true , address=104.36.82.60:4341 , piece_id=L4TF7ED4R6AJWOMXUWRKCX6422JO4ISVJDL2E34DHHJ77NHXOCWQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.390387278 (69h6m58.821467409s) [noise=true , address=104.36.82.3:4770 , piece_id=6CBWYMVPG7S3VY6CYK2VE5UPQDFEFHS6ZXDUMK7WQTJBNAUFTU3Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.395320446 (69h6m58.826400588s) [noise=true , address=104.36.82.23:4475 , piece_id=RSZGZCXFENEOFU3OYOKTERQWXDTJYNOLSDLUS55LXMVKIXA2YGWA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.407301341 (69h6m58.838381462s) [noise=true , address=104.36.82.39:4742 , piece_id=ITJVV4YNV7VWXPMUTZAKNPAZJ4LNQ5N6UE6Q4VOO22TAPMCM7YMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.480912726 (69h6m58.911992857s) [noise=true , address=104.36.82.9:4026 , piece_id=3AMHO4L67ISLVM7W3RYDPTPQPN5DL5X6KVD4B5WDNBNTFL4REJRA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.560735927 (69h6m58.991816128s) [noise=true , address=104.36.82.14:4240 , piece_id=MSY5V2WIVYY5PLHTSUOFSF2IAZN3OUIV3Y6PIJ5HFV2TX5NYZEUA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.582092700 (69h6m59.013172831s) [noise=true , address=104.36.82.16:4316 , piece_id=CC2ELVKMAPM2AWS4AUTNGTZLGWWY3R6BBOCH5WWVGZT65XJNGZMA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626087980 (69h6m59.057168111s) [noise=true , address=104.36.82.19:4408 , piece_id=FVL4TPPOWDRJJFZZTDHUCRA6S2HQGVCGDVSESTO7GADA6PQLMWHQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: <nil> Aug 11 14:33:04.626151912 (69h6m59.057232043s) [seg_pos={0 0}, upload=72033]: Segment reached optimal threshold of 14 pieces. Aug 11 14:33:04.626263285 (69h6m59.057343406s) [noise=true , address=104.36.82.34:4561 , piece_id=KPJTYUDUAUFWSZODFO65FURCFDPALFMR3VKLEPAQTX5K3RMHGSSQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12NTJdWYbLU6o4MTfyp7iPzJCmWYG288BgdGSN8JDcLyYGhCSkb): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626280138 (69h6m59.057360269s) [noise=true , address=104.36.82.59:4334 , piece_id=GDHAX5LZQPG6SSDU3W2Y2BPZQLLKPT2L4YY4UT6EF7V22OVQ5L5Q, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626304675 (69h6m59.057384806s) [noise=true , address=104.36.82.58:4294 , piece_id=PIERBOYUSD2ULFJVRFSVTWL7FJ6Z3NINEFSGR55RJYHPYDABGACQ, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 11 14:33:04.626390389 (69h6m59.05747051s) [noise=true , address=104.36.82.22:4520 , piece_id=EVVEMQQP4MRQQLWBZUQVZUXX2PSVNMWKI5QEV77JOOV3VSJAKKDA, seg_pos={0 0}, upload=72033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tf69f5XQmK4E6Bum2DwaCgSfexAh2v7ZxN9KjfzSCAUN5bTkH): protocol: write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection; write tcp 188.166.225.170:51374->104.36.82.22:4520: use of closed network connection Aug 11 14:33:04.626420406 (69h6m59.057500537s) [seg_pos={0 0}, upload=72033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:33:04.626492534 (69h6m59.057572665s) [upload=72033]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:33:04.626498706 (69h6m59.057578827s) [upload=72033]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:33:06.159535464 (69h7m0.590615625s) [upload=72033]: Done uploading segments... Aug 11 14:33:06.159558638 (69h7m0.590638809s) [upload=72033]: Upload finished. err: <nil> Duration: 7.851480932s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 8.016073863s FAIL (2025-08-11 14:32:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.016094433s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [............X..............................X.X...X..X.....X.] duration: 8.637797275s FAIL (2025-08-11 14:32:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:31:28.797649884 (69h5m23.228730005s) [upload=72008]: Starting upload Aug 11 14:31:28.797724437 (69h5m23.228804568s) [upload=72008]: Done starting upload Aug 11 14:31:28.797985085 (69h5m23.229065216s) [upload=72008]: Uploading segments... Aug 11 14:31:28.798029571 (69h5m23.229109702s) [upload=72008]: Got next segment. Inline: false Aug 11 14:31:28.798057073 (69h5m23.229137204s) [upload=72008]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:31:28.798061191 (69h5m23.229141322s) [upload=72008]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:31:29.295888418 (69h5m23.726968549s) [seg_pos={0 0}, upload=72008]: Begin upload segment... Aug 11 14:31:29.295938112 (69h5m23.727018243s) [seg_pos={0 0}, upload=72008]: Done begin upload segment. Aug 11 14:31:29.295959162 (69h5m23.727039293s) [noise=true , address=45.91.116.7:4039 , piece_id=TG65XLLASGXWBNODCL5MCOODUZXTZ23TOHD6ZM7XFZ6K3CJWIHEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296001143 (69h5m23.727081274s) [noise=true , address=104.36.82.39:4730 , piece_id=72CEQIFEDHHDEPM2IYWUYZCZRZZLTJ27TGSBE6J5MFVZZ47CUF7Q, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296383876 (69h5m23.727464007s) [noise=true , address=104.36.82.59:4302 , piece_id=S6DC2ATWBPANXV5TKHY65YNDXQJHUFKFNWDDWNVRIP5ZNVDUCJHQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296482904 (69h5m23.727563035s) [noise=true , address=104.36.82.17:4332 , piece_id=CWZWQNAJ7MQUEZU2IGMBT4XWGKBXX3J3EMJVXE5R34PXDOSS6UGA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296676134 (69h5m23.727756255s) [noise=true , address=104.36.82.46:4508 , piece_id=7MV3QXE43MYOZJBIIDQVFVHWNOU7O32X76AX5RIO5DL2O67AGNWA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296800813 (69h5m23.727880944s) [noise=true , address=104.36.82.60:4352 , piece_id=4J6WDOP6LV6KI3HXMT4GD6TOJBIXFCMQS5OMACHSFXWTAGUOJMUQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296970838 (69h5m23.728050969s) [noise=true , address=104.36.82.47:4528 , piece_id=57YDF5V7ATJVUSPTQSVGDRQUXTRQRG6EZ2IXZ2ILLMONF23OHL2Q, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297186100 (69h5m23.728266231s) [noise=true , address=104.36.82.61:4382 , piece_id=EDCZDJ2C7IGLCMY3H6IBAP5E2RML7KRWOTVMXPVPFCJFSE3AFUPQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297256535 (69h5m23.728336667s) [noise=true , address=104.36.82.5:4868 , piece_id=6Z2FF4CKEKHMANLDVQ4T5WDKCZJRAVJ2T3IAGWJM4HAVTSXITLRQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297490783 (69h5m23.728570914s) [noise=true , address=104.36.82.42:4799 , piece_id=E7KYT6ZOIDZOABOMQ4RGF6OT66NHDNDI6FSM42XOMJ2NHYSIBBGA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297550768 (69h5m23.728630899s) [noise=true , address=104.36.82.62:4424 , piece_id=L3ZLBFDM6IHAA3UI3EP3V5SRKLRW5O7L5RVF4OYWQSMTB3MAWEEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297822077 (69h5m23.728902208s) [noise=true , address=104.36.82.19:4401 , piece_id=7DEYSAK2NJAZUV4CS4E7MMFPZRD6W4M6S7LAARVU4SH66MYQNRUA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298064261 (69h5m23.729144392s) [noise=true , address=104.36.82.2:4744 , piece_id=RCFYTR2CGUOOEMSBQ5T54DDSA2CI7UAGGSRPK3SIJFI64TT7JCDA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298290163 (69h5m23.729370284s) [noise=true , address=104.36.82.44:4873 , piece_id=5IRE2BYR3S7P3SLQWLJTGT6464P4PPDJUERD3U2ZD7FJ6WCZDQEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298513089 (69h5m23.72959321s) [noise=true , address=104.36.82.18:4379 , piece_id=IGMBV3UKBYLQJF4AQ4Q5EKNVWSSAXKAMCDAD6UK54SQBL4XR42DA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298712121 (69h5m23.729792252s) [noise=true , address=104.36.82.23:4462 , piece_id=PIVYRW7X7TX2B6UPJBI2ZI72EYK337D526RAX6LFGQXJORMCLCBA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298911071 (69h5m23.729991202s) [noise=true , address=104.36.82.37:4670 , piece_id=RAUSLUG6OG5GMMRH3RHL6EO7CYV7EPBXNWSCK3XTIMMBHYTVDO2A, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.299112526 (69h5m23.730192657s) [noise=true , address=104.36.82.34:4558 , piece_id=64VYAMVYN3ZCBBDW5TVJLFVPNHOKMJAZTPBFWULVONTNYNOSB7WQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:30.883303543 (69h5m25.314383674s) [upload=72008]: Next returned nil segment Aug 11 14:31:30.883319604 (69h5m25.314399725s) [upload=72008]: Waiting for error group managing segments... Aug 11 14:31:31.318555088 (69h5m25.749635219s) [noise=true , address=45.91.116.7:4039 , piece_id=TG65XLLASGXWBNODCL5MCOODUZXTZ23TOHD6ZM7XFZ6K3CJWIHEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.368005896 (69h5m25.799086027s) [noise=true , address=104.36.82.19:4401 , piece_id=7DEYSAK2NJAZUV4CS4E7MMFPZRD6W4M6S7LAARVU4SH66MYQNRUA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.394334471 (69h5m25.825414593s) [noise=true , address=104.36.82.18:4379 , piece_id=IGMBV3UKBYLQJF4AQ4Q5EKNVWSSAXKAMCDAD6UK54SQBL4XR42DA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.418160058 (69h5m25.84924018s) [noise=true , address=104.36.82.61:4382 , piece_id=EDCZDJ2C7IGLCMY3H6IBAP5E2RML7KRWOTVMXPVPFCJFSE3AFUPQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.426574378 (69h5m25.857654509s) [noise=true , address=104.36.82.34:4558 , piece_id=64VYAMVYN3ZCBBDW5TVJLFVPNHOKMJAZTPBFWULVONTNYNOSB7WQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.482363172 (69h5m25.913443303s) [noise=true , address=104.36.82.47:4528 , piece_id=57YDF5V7ATJVUSPTQSVGDRQUXTRQRG6EZ2IXZ2ILLMONF23OHL2Q, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.614731051 (69h5m26.045811182s) [noise=true , address=104.36.82.46:4508 , piece_id=7MV3QXE43MYOZJBIIDQVFVHWNOU7O32X76AX5RIO5DL2O67AGNWA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.665634257 (69h5m26.096714388s) [noise=true , address=104.36.82.42:4799 , piece_id=E7KYT6ZOIDZOABOMQ4RGF6OT66NHDNDI6FSM42XOMJ2NHYSIBBGA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.775031383 (69h5m26.206111514s) [noise=true , address=104.36.82.23:4462 , piece_id=PIVYRW7X7TX2B6UPJBI2ZI72EYK337D526RAX6LFGQXJORMCLCBA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.800464647 (69h5m26.231544778s) [noise=true , address=104.36.82.17:4332 , piece_id=CWZWQNAJ7MQUEZU2IGMBT4XWGKBXX3J3EMJVXE5R34PXDOSS6UGA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.807272012 (69h5m26.238352143s) [noise=true , address=104.36.82.37:4670 , piece_id=RAUSLUG6OG5GMMRH3RHL6EO7CYV7EPBXNWSCK3XTIMMBHYTVDO2A, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.861123109 (69h5m26.29220323s) [noise=true , address=104.36.82.59:4302 , piece_id=S6DC2ATWBPANXV5TKHY65YNDXQJHUFKFNWDDWNVRIP5ZNVDUCJHQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.159421814 (69h5m26.590501945s) [noise=true , address=104.36.82.62:4424 , piece_id=L3ZLBFDM6IHAA3UI3EP3V5SRKLRW5O7L5RVF4OYWQSMTB3MAWEEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.217310826 (69h5m26.648390958s) [noise=true , address=104.36.82.39:4730 , piece_id=72CEQIFEDHHDEPM2IYWUYZCZRZZLTJ27TGSBE6J5MFVZZ47CUF7Q, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.217332729 (69h5m26.64841285s) [seg_pos={0 0}, upload=72008]: Segment reached optimal threshold of 14 pieces. Aug 11 14:31:32.217521760 (69h5m26.648601891s) [noise=true , address=104.36.82.2:4744 , piece_id=RCFYTR2CGUOOEMSBQ5T54DDSA2CI7UAGGSRPK3SIJFI64TT7JCDA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217656157 (69h5m26.648736288s) [noise=true , address=104.36.82.60:4352 , piece_id=4J6WDOP6LV6KI3HXMT4GD6TOJBIXFCMQS5OMACHSFXWTAGUOJMUQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217677418 (69h5m26.648757549s) [noise=true , address=104.36.82.44:4873 , piece_id=5IRE2BYR3S7P3SLQWLJTGT6464P4PPDJUERD3U2ZD7FJ6WCZDQEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217763021 (69h5m26.648843152s) [noise=true , address=104.36.82.5:4868 , piece_id=6Z2FF4CKEKHMANLDVQ4T5WDKCZJRAVJ2T3IAGWJM4HAVTSXITLRQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection Aug 11 14:31:32.217773782 (69h5m26.648853913s) [seg_pos={0 0}, upload=72008]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:31:32.217887830 (69h5m26.648967962s) [upload=72008]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:31:32.217908701 (69h5m26.648988832s) [upload=72008]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:31:32.734435244 (69h5m27.165515396s) [upload=72008]: Done uploading segments... Aug 11 14:31:32.734459310 (69h5m27.165539441s) [upload=72008]: Upload finished. err: <nil> Duration: 8.63782635s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X......X................X............X............] duration: 3.435039532s FAIL (2025-08-11 14:32:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 11 14:22:09.180495965 (68h56m3.611576126s) [upload=71848]: Starting upload Aug 11 14:22:09.180591568 (68h56m3.611671699s) [upload=71848]: Done starting upload Aug 11 14:22:09.180690927 (68h56m3.611771079s) [upload=71848]: Uploading segments... Aug 11 14:22:09.180752797 (68h56m3.611832918s) [upload=71848]: Got next segment. Inline: true Aug 11 14:22:09.180757686 (68h56m3.611837817s) [upload=71848]: Waiting for error group managing segments... Aug 11 14:22:09.180792712 (68h56m3.611872844s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:22:09.180797021 (68h56m3.611877152s) [upload=71848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 14:22:09.180799375 (68h56m3.611879506s) [upload=71848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:22:09.477891571 (68h56m3.908971722s) [upload=71848]: Done uploading segments... Aug 11 14:22:09.477914635 (68h56m3.908994766s) [upload=71848]: Upload finished. err: <nil> Duration:* 3.435067856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.498437619s FAIL (2025-08-11 14:32:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.498459773s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.............X..............................X.X...X..X.....X] duration: 5.049346535s FAIL (2025-08-11 14:31:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 14:31:28.797649884 (69h5m23.228730005s) [upload=72008]: Starting upload Aug 11 14:31:28.797724437 (69h5m23.228804568s) [upload=72008]: Done starting upload Aug 11 14:31:28.797985085 (69h5m23.229065216s) [upload=72008]: Uploading segments... Aug 11 14:31:28.798029571 (69h5m23.229109702s) [upload=72008]: Got next segment. Inline: false Aug 11 14:31:28.798057073 (69h5m23.229137204s) [upload=72008]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 14:31:28.798061191 (69h5m23.229141322s) [upload=72008]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 14:31:29.295888418 (69h5m23.726968549s) [seg_pos={0 0}, upload=72008]: Begin upload segment... Aug 11 14:31:29.295938112 (69h5m23.727018243s) [seg_pos={0 0}, upload=72008]: Done begin upload segment. Aug 11 14:31:29.295959162 (69h5m23.727039293s) [noise=true , address=45.91.116.7:4039 , piece_id=TG65XLLASGXWBNODCL5MCOODUZXTZ23TOHD6ZM7XFZ6K3CJWIHEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296001143 (69h5m23.727081274s) [noise=true , address=104.36.82.39:4730 , piece_id=72CEQIFEDHHDEPM2IYWUYZCZRZZLTJ27TGSBE6J5MFVZZ47CUF7Q, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296383876 (69h5m23.727464007s) [noise=true , address=104.36.82.59:4302 , piece_id=S6DC2ATWBPANXV5TKHY65YNDXQJHUFKFNWDDWNVRIP5ZNVDUCJHQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296482904 (69h5m23.727563035s) [noise=true , address=104.36.82.17:4332 , piece_id=CWZWQNAJ7MQUEZU2IGMBT4XWGKBXX3J3EMJVXE5R34PXDOSS6UGA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296676134 (69h5m23.727756255s) [noise=true , address=104.36.82.46:4508 , piece_id=7MV3QXE43MYOZJBIIDQVFVHWNOU7O32X76AX5RIO5DL2O67AGNWA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296800813 (69h5m23.727880944s) [noise=true , address=104.36.82.60:4352 , piece_id=4J6WDOP6LV6KI3HXMT4GD6TOJBIXFCMQS5OMACHSFXWTAGUOJMUQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.296970838 (69h5m23.728050969s) [noise=true , address=104.36.82.47:4528 , piece_id=57YDF5V7ATJVUSPTQSVGDRQUXTRQRG6EZ2IXZ2ILLMONF23OHL2Q, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297186100 (69h5m23.728266231s) [noise=true , address=104.36.82.61:4382 , piece_id=EDCZDJ2C7IGLCMY3H6IBAP5E2RML7KRWOTVMXPVPFCJFSE3AFUPQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297256535 (69h5m23.728336667s) [noise=true , address=104.36.82.5:4868 , piece_id=6Z2FF4CKEKHMANLDVQ4T5WDKCZJRAVJ2T3IAGWJM4HAVTSXITLRQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297490783 (69h5m23.728570914s) [noise=true , address=104.36.82.42:4799 , piece_id=E7KYT6ZOIDZOABOMQ4RGF6OT66NHDNDI6FSM42XOMJ2NHYSIBBGA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297550768 (69h5m23.728630899s) [noise=true , address=104.36.82.62:4424 , piece_id=L3ZLBFDM6IHAA3UI3EP3V5SRKLRW5O7L5RVF4OYWQSMTB3MAWEEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.297822077 (69h5m23.728902208s) [noise=true , address=104.36.82.19:4401 , piece_id=7DEYSAK2NJAZUV4CS4E7MMFPZRD6W4M6S7LAARVU4SH66MYQNRUA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298064261 (69h5m23.729144392s) [noise=true , address=104.36.82.2:4744 , piece_id=RCFYTR2CGUOOEMSBQ5T54DDSA2CI7UAGGSRPK3SIJFI64TT7JCDA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298290163 (69h5m23.729370284s) [noise=true , address=104.36.82.44:4873 , piece_id=5IRE2BYR3S7P3SLQWLJTGT6464P4PPDJUERD3U2ZD7FJ6WCZDQEQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298513089 (69h5m23.72959321s) [noise=true , address=104.36.82.18:4379 , piece_id=IGMBV3UKBYLQJF4AQ4Q5EKNVWSSAXKAMCDAD6UK54SQBL4XR42DA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298712121 (69h5m23.729792252s) [noise=true , address=104.36.82.23:4462 , piece_id=PIVYRW7X7TX2B6UPJBI2ZI72EYK337D526RAX6LFGQXJORMCLCBA, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.298911071 (69h5m23.729991202s) [noise=true , address=104.36.82.37:4670 , piece_id=RAUSLUG6OG5GMMRH3RHL6EO7CYV7EPBXNWSCK3XTIMMBHYTVDO2A, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:29.299112526 (69h5m23.730192657s) [noise=true , address=104.36.82.34:4558 , piece_id=64VYAMVYN3ZCBBDW5TVJLFVPNHOKMJAZTPBFWULVONTNYNOSB7WQ, seg_pos={0 0}, upload=72008]: Uploading piece... Aug 11 14:31:30.883303543 (69h5m25.314383674s) [upload=72008]: Next returned nil segment Aug 11 14:31:30.883319604 (69h5m25.314399725s) [upload=72008]: Waiting for error group managing segments... Aug 11 14:31:31.318555088 (69h5m25.749635219s) [noise=true , address=45.91.116.7:4039 , piece_id=TG65XLLASGXWBNODCL5MCOODUZXTZ23TOHD6ZM7XFZ6K3CJWIHEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.368005896 (69h5m25.799086027s) [noise=true , address=104.36.82.19:4401 , piece_id=7DEYSAK2NJAZUV4CS4E7MMFPZRD6W4M6S7LAARVU4SH66MYQNRUA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.394334471 (69h5m25.825414593s) [noise=true , address=104.36.82.18:4379 , piece_id=IGMBV3UKBYLQJF4AQ4Q5EKNVWSSAXKAMCDAD6UK54SQBL4XR42DA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.418160058 (69h5m25.84924018s) [noise=true , address=104.36.82.61:4382 , piece_id=EDCZDJ2C7IGLCMY3H6IBAP5E2RML7KRWOTVMXPVPFCJFSE3AFUPQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.426574378 (69h5m25.857654509s) [noise=true , address=104.36.82.34:4558 , piece_id=64VYAMVYN3ZCBBDW5TVJLFVPNHOKMJAZTPBFWULVONTNYNOSB7WQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.482363172 (69h5m25.913443303s) [noise=true , address=104.36.82.47:4528 , piece_id=57YDF5V7ATJVUSPTQSVGDRQUXTRQRG6EZ2IXZ2ILLMONF23OHL2Q, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.614731051 (69h5m26.045811182s) [noise=true , address=104.36.82.46:4508 , piece_id=7MV3QXE43MYOZJBIIDQVFVHWNOU7O32X76AX5RIO5DL2O67AGNWA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.665634257 (69h5m26.096714388s) [noise=true , address=104.36.82.42:4799 , piece_id=E7KYT6ZOIDZOABOMQ4RGF6OT66NHDNDI6FSM42XOMJ2NHYSIBBGA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.775031383 (69h5m26.206111514s) [noise=true , address=104.36.82.23:4462 , piece_id=PIVYRW7X7TX2B6UPJBI2ZI72EYK337D526RAX6LFGQXJORMCLCBA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.800464647 (69h5m26.231544778s) [noise=true , address=104.36.82.17:4332 , piece_id=CWZWQNAJ7MQUEZU2IGMBT4XWGKBXX3J3EMJVXE5R34PXDOSS6UGA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.807272012 (69h5m26.238352143s) [noise=true , address=104.36.82.37:4670 , piece_id=RAUSLUG6OG5GMMRH3RHL6EO7CYV7EPBXNWSCK3XTIMMBHYTVDO2A, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:31.861123109 (69h5m26.29220323s) [noise=true , address=104.36.82.59:4302 , piece_id=S6DC2ATWBPANXV5TKHY65YNDXQJHUFKFNWDDWNVRIP5ZNVDUCJHQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.159421814 (69h5m26.590501945s) [noise=true , address=104.36.82.62:4424 , piece_id=L3ZLBFDM6IHAA3UI3EP3V5SRKLRW5O7L5RVF4OYWQSMTB3MAWEEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.217310826 (69h5m26.648390958s) [noise=true , address=104.36.82.39:4730 , piece_id=72CEQIFEDHHDEPM2IYWUYZCZRZZLTJ27TGSBE6J5MFVZZ47CUF7Q, seg_pos={0 0}, upload=72008]: Done uploading piece. err: <nil> Aug 11 14:31:32.217332729 (69h5m26.64841285s) [seg_pos={0 0}, upload=72008]: Segment reached optimal threshold of 14 pieces. Aug 11 14:31:32.217521760 (69h5m26.648601891s) [noise=true , address=104.36.82.2:4744 , piece_id=RCFYTR2CGUOOEMSBQ5T54DDSA2CI7UAGGSRPK3SIJFI64TT7JCDA, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217656157 (69h5m26.648736288s) [noise=true , address=104.36.82.60:4352 , piece_id=4J6WDOP6LV6KI3HXMT4GD6TOJBIXFCMQS5OMACHSFXWTAGUOJMUQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217677418 (69h5m26.648757549s) [noise=true , address=104.36.82.44:4873 , piece_id=5IRE2BYR3S7P3SLQWLJTGT6464P4PPDJUERD3U2ZD7FJ6WCZDQEQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 11 14:31:32.217763021 (69h5m26.648843152s) [noise=true , address=104.36.82.5:4868 , piece_id=6Z2FF4CKEKHMANLDVQ4T5WDKCZJRAVJ2T3IAGWJM4HAVTSXITLRQ, seg_pos={0 0}, upload=72008]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection; write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45178->104.36.82.5:4868: use of closed network connection Aug 11 14:31:32.217773782 (69h5m26.648853913s) [seg_pos={0 0}, upload=72008]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 14:31:32.217887830 (69h5m26.648967962s) [upload=72008]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 14:31:32.217908701 (69h5m26.648988832s) [upload=72008]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 14:31:32.734435244 (69h5m27.165515396s) [upload=72008]: Done uploading segments... Aug 11 14:31:32.734459310 (69h5m27.165539441s) [upload=72008]: Upload finished. err: <nil> Duration: 5.049383657s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)